If AI systems do not achieve a true spark of generalization, they could become extremely good at benchmarked tasks while persistent simulation-to-reality problems limit their broader impact.

“like there's been a classic thing almost like marvex paradox right where like we see like you know we think of the ai being like if it can do this it's going to be amazing right like if it can solve these hard math problems if it can win a chess blah blah and then it solves these things and then it's like not that impactful obviously it's somewhat impactful but like not everything it's like if somehow that continues and like there's never like the true like spark of generalization that occurs i think that could lead to like the ai just being like extremely good at kind of everything that people like put into a benchmark”

“to incorporate into an environment but like there's still some persistent like sim to real which is somehow blocking everything i think this is kind of unlikely i think we do actually see this kind of generalization even from RL in practice already but”