descriptive claim
Pratik said Galileo aggregated sample scores by dataset and averaged the dataset scores to calculate the overall ranking score.
Pratik Bhavsar · ⚡️Ranking Agentic LLMs — Pratik Bhavsar, Galileo · 14 Jul 2025
In their words
The transcript segments this claim was taken from
“for tool calling and we use a used a gallows metric called tool selection quality which is an LLM judge based metric powered by GPT 4.0 and it has multiple judges so that we get high performance and that's how we kind of get the score for each sample and we aggregate for a data set and then we do average over the data set and that's how we get the overall score for the ranking but yes customers sorry”4:36Report a misattribution
0.95how strongly it was put, not whether it is true
0.70importance to the conversation
0.95confidence the claim was read correctly