The speaker allows that a cognitive core could be smaller than one billion parameters, while maintaining that a practical model should contain some knowledge.

“i mean i almost feel like i'm already contrarian by talking about a billion parameter cognitive core and you're outdoing me i think um yeah maybe we could get a little bit smaller i mean i still think that there should be enough”

“enough yeah maybe it can be smaller i do think that practically speaking you want the model to have some knowledge”