prediction claim
A superficial reward signal, such as whether a user accepts a code edit, might be reward-hacked.
John Schulman · AI researchers debate how close we are to recursive self-improvement · 11 Sep 2026
In their words
The transcript segments this claim was taken from
“And if you use some kind of superficial signal, like did they accept the code,”
“the edit,”
“that might get reward hacked in some way.”45:13Report a misattribution
0.65how strongly it was put, not whether it is true
0.75importance to the conversation
0.98confidence the claim was read correctly