descriptive claim
The speaker says the LifeCode BenchPro used entirely new problems and that two careful studies ruled out data contamination.
Unidentified speaker · Three Red Lines We're About to Cross Toward AGI (Daniel Kokotajlo, Gary Marcus, Dan Hendrycks) · 24 Jun 2025
In their words
The transcript segments this claim was taken from
“excuse me, was that they were all brand new problems.”
“And so they ruled out data contamination. And I've seen two careful studies ruling out data contamination.”Play from 1:35:47Report a misattribution
90%how strongly it was put, not whether it is true
70%importance to the conversation
82%confidence the claim was read correctly