descriptive claim
A large language model fits a categorical distribution whose autoregressive structure decomposes the overall probability density.
Alexander Mattick · Why Scaling Prediction Cannot Create Intelligence - Alexander Mattick · 21 Sept 2026
In their words
The transcript segments this claim was taken from
“And if you go and you fit a categorical distribution,”
“like you do your large language model,”
“you have your kind of density,”
“which is effectively like an autoregressive structure,”
“that is just a decomposition of your final density.”Play from 11:38Report a misattribution
85%how strongly it was put, not whether it is true
70%importance to the conversation
85%confidence the claim was read correctly