Karpathy wanted agents to operate in the real digital world and perform knowledge work, but believes the effort began far too early.

“And I really wanted to have something that like interact.”

“tracked with you know the actual digital world that can do knowledge work and it just so turns out that this was extremely early way too early so early that we shouldn't have been working on that you know because if you're just stumbling your way around and keyboard mashing and mouse clicking and trying to get rewards in these environments your reward is too sparse and you just won't learn and you're going to burn a forest computing and you're never actually going to get something off the ground and so what you're missing is this power of”