The speaker wants models to rely less on stored knowledge, look information up when needed, and retain reasoning and experimentation algorithms instead.

“I'd love to have less memory so that they have to look things up and they only maintain the algorithms for like thought and the idea of an experiment and all this cognitive glue of acting.”