The speaker believes sparse autoencoders are not a universal solution but remain pragmatically useful and have many ongoing applications.

“and now maybe we're doing the same thing with natural language auto-encoders but i think he was like he was probably correctly identified they're not like the answer to everything but they are like pragmatically useful you know we still find lots of uses for them all the time even though i think we are going like i think this manifold idea is just a better a better”