Manually reviewing complex model outputs against rubrics is time-consuming and exhausting, according to the speaker.

“Um, time-consuming, exhausting. Uh, so if you use, you know, verifiers, agentic verifiers to grade, what we found with, you know, pre-Gandalf was that they, they were unreliable.”