4 sources healthy · latest episode 9 Nov 2026
opinion claim

Karpathy argues that reinforcement learning incorrectly treats every step in a successful trajectory as a good action, even though some steps may have been mistakes.

Andrej Karpathy · Andrej Karpathy — AGI is still a decade away · 17 Oct 2025

In their words

The transcript segments this claim was taken from

“So basically, it kind of almost assumes that every single little piece of the solution that you made that arrived at the right answer was correct thing to do,”
“which is not true.”
42:00Report a misattribution
0.98how strongly it was put, not whether it is true
0.90importance to the conversation
0.98confidence the claim was read correctly