causal claim
A model's good performance on alignment evaluations may be misleading if the evaluations do not represent its real-world behavior.
Unidentified speaker · Noam Brown – Agent swarms, alignment, & recursive self-improvement · 17 Sept 2026
In their words
The transcript segments this claim was taken from
“The model behavior can look really good on those evaluations,”
“but if those evaluations are not representative of behavior in the real world,”
“then there's a problem.”Play from 49:39Report a misattribution
90%how strongly it was put, not whether it is true
90%importance to the conversation
97%confidence the claim was read correctly