descriptive claim
In its original 2024 paper, Inception reported parity with autoregressive models on perplexity, which Ermon described as a measure of how much structure a model identifies in data.
Stefano Ermon · Why Diffusion Will Win AI Inference with Inception Co-Founder and CEO Stefano Ermon · 18 Sept 2026
In their words
The transcript segments this claim was taken from
“And when I mentioned the original 2024 paper,”
“when we showed that we are achieving parity with autoregressive models,”
“the metric that we're using is basically perplexity, which is a notion of”
“motion of how much structure have you identified in the data and so even though it might not seem obvious we were actually able to identify at the GPT-2 scale”Play from 23:22Report a misattribution
90%how strongly it was put, not whether it is true
85%importance to the conversation
91%confidence the claim was read correctly