The speaker is uncertain whether simulation-to-reality transfer will teach models to improve at complex real-world tasks, and suggests that weight updates from real-world interactions may instead be necessary.

“eventually super intelligence should be able to like run a business or like start a new business and make it profitable or like have a profitable day trading in the markets or win a court case and these are all things which are very hard to simulate in a data center like an inherent part of the learning there is interacting with the real world and so maybe maybe they may not learn how to get better at these things from like the transfer between sim to real but alternatively maybe you do need weight updates from these kinds of interactions”