Pratik said Galileo scored samples with its Tool Selection Quality metric, an LLM-judge-based metric powered by GPT-4.0 and using multiple judges.

“for tool calling and we use a used a gallows metric called tool selection quality which is an LLM judge based metric powered by GPT 4.0 and it has multiple judges so that we get high performance and that's how we kind of get the score for each sample and we aggregate for a data set and then we do average over the data set and that's how we get the overall score for the ranking but yes customers sorry”