The speaker says the financial evaluations were saturated, and remaining wrong answers resulted from incorrect answer keys, poorly specified prompts, or other flaws in the evaluations.

“Uh, we, like, the-- Basically, we found that we had saturated the evals, and the questions that we were getting wrong were driven by incorrect answer keys, um, poorly specified prompts, or just some other flaw with the eval.”