Ermon was excited by the result and wanted to test how diffusion language models would perform at larger scales.

“Then X-Faster compared to the auto-aggressive model and so that felt very very exciting and I really wanted to see what happens if you scale up, if you train bigger models and so I started Inception,”