Tom McGrath thinks researchers should apply the normalized-density approach to neural-network activations as well.

“um so you can say oh yes this image is like extremely natural this image is extremely wacky um you know and they put they use this this tool to exactly probe this kind of manifold hypothesis in in real image data i think that that paper is like extremely extremely beautiful underappreciated and someone should do it for activations too”