Foundation models typically learn a state space, while predicting how the state changes under an action or perturbation requires more world-model-like approaches.

“Sorry for making the subtlety again, but I think typically you learn the state space with these foundation models, but then sort of the way how they behave under an action, under perturbation, this is where you need this more world model-like type of approaches.”