The speaker says benchmarks function like exams that measure model capability, while taking exams is not the purpose of becoming a mathematician.

“yes uh so i would say a lot of benchmark is just like it's just like exams right like you take the purpose of becoming a mathematician is not to take exams it can give you like uh it's the same for any any any job too it kind of give you a like a benchmark or like a”

“like a matrix to see how good these model are but you really need to put them into the battlefield right and the goal of a mathematician is you want to push forward the frontier of math”