The speaker considered BFCL's simple math-style tool-calling tasks unrealistic for practical evaluation, while acknowledging that BFCL was the best available option at the time.

“to be harder and this tool calling to be more complicated and realistic at the same time this bfcl if you just open and check it you would be like okay this is okay but you don't want to use it for realistic evaluation because it's like some math”

“problem statement is given some simple tool is given just like let's say some exponential to logarithmic to multiplication stuff and you are just like evaluating on that so I was not particularly happy with that but that's the best we could got get at the time and that's why we mixed up all the data sets available at the time to kind of average out the things because very specific right if some model is good at math then it might perform really good”