The speaker says it is very difficult to build an evaluation that correlates with the skill or capability it is intended to measure.

“Peop-- You know, that's not obvious to people who haven't worked on an eval before. Um, to build an eval that actually, like, correlates with the thing that you're actually trying to measure, like the skill that you're trying to measure, capability you're trying to measure, very difficult.”