descriptive claim
In 2024, Stefano Ermon's team reported that a diffusion model with fewer than one billion parameters could match an autoregressive model's quality at the GPT-2 scale.
Stefano Ermon · Why Diffusion Will Win AI Inference with Inception Co-Founder and CEO Stefano Ermon · 18 Sept 2026
In their words
The transcript segments this claim was taken from
“We had a breakthrough in 2024.”
“We published a paper basically showing that for the first time it was possible to match the quality of an autoregressive model at the GPT-2 scale.”
“So less than a billion parameters,”Play from 5:03Report a misattribution
95%how strongly it was put, not whether it is true
85%importance to the conversation
97%confidence the claim was read correctly