The speaker considers a paper that extracted modular arithmetic in grokking one of the best explainability papers they had seen.

“I if it was like this then we would need to be able to make predictions that say, well if we go away from the splines maybe it doesn't work anymore. Or like to what extent does it stop working? And then there the explainability people that say, well we can actually extract uh this and that circuit or we can extract this and that representation. Like maybe one of the the best papers I I saw in like explainability was the paper about grokking where they ex where they extracted like the modular arithmetic.”