Karpathy identifies task-specific neural-network training, early agent development, and LLM-based representation learning before adding further capabilities as three broad approaches in AI.

“But I would say maybe those are like the three major buckets of what people were doing,”

“training neural nets per tasks,”

“trying to the first round of agents,”

“and then maybe the LLMs and actually seeking the representation power of the neural networks before you tack on everything else on top.”