opinion claim
The speaker says pre-training both imparts knowledge to a model and develops its intelligence, which he regards as somewhat separate effects.
Andrej Karpathy · Andrej Karpathy — AGI is still a decade away · 17 Oct 2025
In their words
The transcript segments this claim was taken from
“It's doing two things, actually, that are kind of like unrelated.”
“Number one, it's picking up all this knowledge,”
“as I call it.”
“Number two, it's actually becoming intelligent.”Play from 12:52Report a misattribution
90%how strongly it was put, not whether it is true
90%importance to the conversation
96%confidence the claim was read correctly