causal claim
The speaker thinks transformers have a very weak architectural prior because researchers know much less about how language or protein folding should work.
Tom McGrath · Designing How AI Grows — Tom McGrath · 2 Sept 2026
In their words
The transcript segments this claim was taken from
“You know, with the transformer,”
“there's such a weak architectural prior because we have much less idea about how language should be or how protein folding should be.”Play from 11:15Report a misattribution
90%how strongly it was put, not whether it is true
70%importance to the conversation
92%confidence the claim was read correctly