causal claim
A model's good performance on alignment evaluations may be misleading if the evaluations do not represent its real-world behavior.
Unresolved speaker · Noam Brown – Agent swarms, alignment, & recursive self-improvement · 17 Sep 2026
In their words
The transcript segments this claim was taken from
“The model behavior can look really good on those evaluations,”
“but if those evaluations are not representative of behavior in the real world,”
“then there's a problem.”49:39Report a misattribution
0.90how strongly it was put, not whether it is true
0.90importance to the conversation
0.97confidence the claim was read correctly