The speaker believes Neil Nanda did not mean that sparse autoencoders are dead, and that the field overreacted by treating them as something everyone must use.

“there's the thing that he said about deprioritizing SAEs and maybe they're not the one true representation learner there's like how people kind of memed it which is like Neil Nanda says SAEs are dead um there you go you can use that for the intro and um and I don't think that that is actually what he meant I think the field sort of like jumped on everyone must do SAEs now um”