descriptive claim
A sparse autoencoder can be placed in a transformer's residual stream, which the speaker describes as the transformer's backbone.
Tom McGrath · Designing How AI Grows — Tom McGrath · 2 Sept 2026
In their words
The transcript segments this claim was taken from
“this is a sort of gadget that you put in the residual stream,”
“and it's a sort of backbone of the transformer.”Play from 17:18Report a misattribution
95%how strongly it was put, not whether it is true
55%importance to the conversation
97%confidence the claim was read correctly