opinion claim
The speaker is concerned that the extent of data contamination and augmentation in the coding benchmarks is unknown.
Tim Scarfe · Three Red Lines We're About to Cross Toward AGI (Daniel Kokotajlo, Gary Marcus, Dan Hendrycks) · 24 Jun 2025
In their words
The transcript segments this claim was taken from
“I'm very concerned from a scientific perspective that we don't know how much data contamination there is, we don't know how much augmentation is done relative to those benchmarks and so forth, which leads me to my next point about it, which is, I can't, I'm blanking on the guy's name from 80,000 hours,”Play from 1:12:44Report a misattribution
90%how strongly it was put, not whether it is true
80%importance to the conversation
90%confidence the claim was read correctly