causal claim
The speaker says production systems omit more adversarially robust techniques because they may reduce MMLU performance by about one or two percentage points.
Unidentified speaker · Three Red Lines We're About to Cross Toward AGI (Daniel Kokotajlo, Gary Marcus, Dan Hendrycks) · 24 Jun 2025
In their words
The transcript segments this claim was taken from
“So in production they're not using, they're not using the techniques that are as adversarially robust because they come at a cost of maybe a percent or two in M_M_L_U_”
“and so they're”Play from 1:43:42Report a misattribution
80%how strongly it was put, not whether it is true
90%importance to the conversation
88%confidence the claim was read correctly