The host said agent comparisons can be misleading when one system spends more tokens or money for better performance, because another system might match that performance with the same resources by thinking harder.

“stay very honest with like oh yeah like we spent a lot more tokens or we spent a lot more money on this agents and we did better but it's not really clear like if the other comparison could also just do the same thing like just think harder and also have the same performance”