The speaker says Modal’s system can automatically reallocate thousands of GPUs between models, including shifting half the capacity by the next day, without a customer instructing it.

“But I, I do think, you know, there's an argument that it's very easy for Modal to like, you know, right today we're running, you know, X number of thousand GPUs for one model.”

“Tomorrow we need to shift like, you know, fifty percent of that to another model. Sure. That's just like, that's what the system is built to handle. Yeah. No one even needs to tell us to do that.”