descriptive claim
Google's Minerva scored 50% on a mathematics benchmark that the speaker says he had created before 2022.
Unidentified speaker · Three Red Lines We're About to Cross Toward AGI (Daniel Kokotajlo, Gary Marcus, Dan Hendrycks) · 24 Jun 2025
In their words
The transcript segments this claim was taken from
“mathematical reasoning would be a recent example with Minerva. Google's Minerva system got 50% on the math benchmark,”
“some benchmark I made some while ago,”
“in 2022.”Play from 1:21:49Report a misattribution
90%how strongly it was put, not whether it is true
65%importance to the conversation
88%confidence the claim was read correctly