Until recently, the speaker considered complex evaluations not worthwhile because models were improving broadly.

“Evals, um, grew out of the assistant agent team at some point. I think there was a point up until recently where it was like, honestly, just not really worth it 'cause, like, all models just got better.”