In its original 2024 paper, Inception reported parity with autoregressive models on perplexity, which Ermon described as a measure of how much structure a model identifies in data.

“And when I mentioned the original 2024 paper,”

“when we showed that we are achieving parity with autoregressive models,”

“the metric that we're using is basically perplexity, which is a notion of”

“motion of how much structure have you identified in the data and so even though it might not seem obvious we were actually able to identify at the GPT-2 scale”