The speaker expects many small models to coexist with increasingly large models, and says larger models require more memory and compute for inference.

“Um, you know, again, that's, that's, those are just the big models, right? Like you're also gonna have tons of small models, um- But I know the big models are getting bigger, which only require more memory, um, and more compute to run.”