4 sources healthy · latest episode 9 Nov 2026
descriptive claim

A paper hard-coded neural-network weights so gradient descent was implemented through attention and other network internals.

Andrej Karpathy · Andrej Karpathy — AGI is still a decade away · 17 Oct 2025

In their words

The transcript segments this claim was taken from

“In fact, I think even the paper was stronger because they actually hard-coded the weights of a neural network to do gradient descent through”
“attention and all the internals of the neural network.”
16:10Report a misattribution
0.80how strongly it was put, not whether it is true
0.75importance to the conversation
0.94confidence the claim was read correctly