As AI agents improve and require training on longer-horizon, more complex tasks within environments, the cost per unit of training data increases meaningfully.

“He's like the-- Yeah, he's, uh... He really saw this kinda early, but, um, but I think, you know, uh, uh, as the agents get better and better and better and better, and the things we need to train them on are, like, longer horizon, you know, uh, more complex within environments, et cetera, the cost per unit of data increases meaningfully, and the other ways to get that kind of data, like, don't exist.”