descriptive claim
A large language model fits a categorical distribution whose autoregressive structure decomposes the overall probability density.
Alexander Mattick · Why Scaling Prediction Cannot Create Intelligence - Alexander Mattick · 21 Sep 2026
In their words
The transcript segments this claim was taken from
“And if you go and you fit a categorical distribution,”
“like you do your large language model,”
“you have your kind of density,”
“which is effectively like an autoregressive structure,”
“that is just a decomposition of your final density.”11:38Report a misattribution
0.85how strongly it was put, not whether it is true
0.70importance to the conversation
0.85confidence the claim was read correctly