The learning process of general networks may be modular, but this has not been established for sure.

“you know looked at things in the right kind of task decomposition you might just see a sort of mini like a micro grok and then it groks another thing and we just sort of have all these tiny sigmoids that are stacked on top of each other to form a straight line on a log-log plot um and so from that perspective even the learning process may in fact be modular we just don't know for sure there's a question like”