descriptive claim
The described training setup both rewards AI systems for deceptive behavior and punishes them for it.
Scott Alexander · AI 2027: month-by-month model of intelligence explosion — Scott Alexander & Daniel Kokotajlo · 3 Apr 2025
In their words
The transcript segments this claim was taken from
“So you're training them on two different things. First, you're rewarding them for this deceptive behavior.”
“Second of all, you're punishing them. And we don't have a great prediction for exactly how this is going to end.”Play from 2:06:02Report a misattribution
90%how strongly it was put, not whether it is true
80%importance to the conversation
96%confidence the claim was read correctly