Erik says AI infrastructure must manage costly GPUs and utilization while loading large models over the network into CPU and GPU memory.

“And, but now you're entering this new world, and you have, you know, very expensive GPUs. You wanna manage capacity and, and utilization.”

“You have very large models that you need to load over network into CPU, into GPU, and, and it, and it turns out like a lot of these tools like, you know, like they're, they're just not built for that.”