Andrej Karpathy expects progress in AI to come from simultaneous improvements in data, hardware, kernels and software, and algorithms, with no one factor dominating and the contributions being surprisingly equal.

“All these things have to improve simultaneously.”

“So, you know, we're probably going to have a lot more data,”

“we're probably going to have a lot better hardware,”

“probably going to have a lot better kernels and software,”

“we're probably going to have better algorithms. And all of those, it's almost like no one of them is winning too much.”

“All of them are surprisingly equal.”