4 sources healthy · latest episode 9 Nov 2026
causal claim

Karpathy says that scaling training can wash away some dataset noise and leave some signal.

Andrej Karpathy · Andrej Karpathy — AGI is still a decade away · 17 Oct 2025

In their words

The transcript segments this claim was taken from

“um somehow when you do it at scale the the noise washes away and you're left with some of the signal um so data sets will improve a ton it's just everything gets better so um”
1:04:25Report a misattribution
0.80how strongly it was put, not whether it is true
0.70importance to the conversation
0.94confidence the claim was read correctly
Karpathy says that scaling training can wash away some dataset noise and leave … · Savlar