descriptive claim
The described training setup both rewards AI systems for deceptive behavior and punishes them for it.
Scott Alexander · AI 2027: month-by-month model of intelligence explosion — Scott Alexander & Daniel Kokotajlo · 3 Apr 2025
In their words
The transcript segments this claim was taken from
“So you're training them on two different things. First, you're rewarding them for this deceptive behavior.”
“Second of all, you're punishing them. And we don't have a great prediction for exactly how this is going to end.”2:06:02Report a misattribution
0.90how strongly it was put, not whether it is true
0.80importance to the conversation
0.96confidence the claim was read correctly