Karpathy says reinforcement learning can reinforce mistaken intermediate actions when they occur in a trajectory that ultimately reaches the correct answer.

“Like you may have gone down the wrong alleys until you arrived at the right solution.”

“Every single one of those incorrect things you did,”

“as long as you got to the correct solution,”

“will be upweighted as do more of this.”