Andrej Karpathy expects AI training datasets to improve substantially because he considers current average datasets extremely poor and full of factual mistakes, errors, and nonsensical examples.

“I expect the data sets to get much, much better because when you look at the average data sets, they're extremely terrible,”

“like so bad that I don't even know how anything works, to be honest, like look at the average example in the training set.”

“It like factual mistakes,”

“errors,”

“nonsensical things.”