The speaker doubts that LLMs can infer causal laws well and does not expect them anytime soon to produce Einstein-level, radically different solutions to problems.

“are able to infer causal laws and they're not that good at it like I don't expect that an LLM is going to do Einstein level look at a problem come up with a completely different solution anytime soon all the solutions they have seem to me to be kind of inside the box and I think that getting to AGI is going to require outside the box solutions they might automate the stuff inside the box and inside the box”