The speaker thinks a model needs basic internal knowledge for reasoning and should not rely on lookup for everything, though it does not need esoteric knowledge.

“don't want it to be looking up everything um because then you can't like think in your head you're looking up way too much stuff all the time so i do think it needs to be some basic curriculum needs to be there for knowledge uh but it doesn't have esoteric knowledge you know”