4 sources healthy · latest episode 9 Nov 2026
opinion claim

A major challenge is determining the appropriate reward function from natural data.

John Schulman · AI researchers debate how close we are to recursive self-improvement · 11 Sep 2026

In their words

The transcript segments this claim was taken from

“Yeah, I think your biggest problem is actually just not knowing what the reward function should be from natural data.”
45:08Report a misattribution
0.90how strongly it was put, not whether it is true
0.80importance to the conversation
0.98confidence the claim was read correctly