definition claim
The tool selection quality metric measures whether the agent selected the correct tool.
Pratik Bhavsar · ⚡️Ranking Agentic LLMs — Pratik Bhavsar, Galileo · 14 Jul 2025
In their words
The transcript segments this claim was taken from
“is like salt that okay the scores are lower we are getting domain specific insights and then it's a very realistic scenario where you are having multiple turn and then only finally when everything is done then the task is accomplished so what how do we evaluate the performance in this case and we use two metrics we use the older one the tool selection quality which is just telling us whether the tool selected was correct or not”30:18Report a misattribution
0.95how strongly it was put, not whether it is true
0.70importance to the conversation
0.97confidence the claim was read correctly