The speaker believes much language-model inference work remains systems-driven, since KV caching and routing are systems-like problems.

“And, you know, e-even though I actually, like, will say a lot of the work [chuckles] in that space, in my opinion, turns out is, like, more systems driven still, 'cause it turns out, like, KV caching and routing is actually, like, is still, like, very, like, systems-like.”