Tom McGrath says block-sparse futurizers extend the sparse-autoencoder representation from one-dimensional lines to higher-dimensional subspaces.

“And the idea here is that we train what we call like block sparse futurizers.”

“then the idea here is that you know an SAE gives you a line we just say like what if it was a higher dimension and so this is conceptually pretty simple but the the trick the tricks are like”