In a different regime, deployed AIs learn from deployment: activity in the world returns to AI companies and leads to changes in subsequent models.

“at a high level, that reinforcement is coming from, we're in a very different regime. I think people might get confused about where the reinforcement is coming from because we're in a very different regime where AIs are actually learning from deployment.”

“And so this is, like you just have AIs that are out and about in the world,”

“like doing.”

“doing shit and that what is happening as a result of them doing shit out and about in the world is like making its way back to the AI company and leading to changes”

“in the next model.”