Inception serves its diffusion-based LLMs to real customers in production and built a custom serving engine because existing LLM serving engines could not run them.

“actually use the like we are serving these models in production today we did all the work of figuring out how to even just like build a serving engine right you cannot run this diffusion-based LLMs on the LLM or SG language you have we have to build our own serving engine and we can handle a lot of the complexity of like real production workloads and we've solved all these challenges and we can deliver this kind of new experience”

“yes end to end to to real customers today yeah”