descriptive claim
Dan says he has recently evaluated AI capabilities using MMLU, a math benchmark, and Humanity's Last Exam.
Unidentified speaker · Three Red Lines We're About to Cross Toward AGI (Daniel Kokotajlo, Gary Marcus, Dan Hendrycks) · 24 Jun 2025
In their words
The transcript segments this claim was taken from
“More recently, I've done evaluations to evaluate capabilities such as MMLU and the math benchmark and humanity's last exam.”Play from 3:52Report a misattribution
95%how strongly it was put, not whether it is true
55%importance to the conversation
95%confidence the claim was read correctly