The speaker thinks heavily overparameterized models with no strong priors are helpful for forming computations, with modularity as the eventual destination.

“um you know i can say like ah this is where such and so computation is stored um now to get there you have to form these computations and i think it's very helpful to be like heavily over parameterized and have no strong priors to get there but i think modularity is like the destination”