The speaker argues that spline-based accounts should predict the conditions or extent to which their explanations fail, including when inputs move away from spline regions.

“I if it was like this then we would need to be able to make predictions that say, well if we go away from the splines maybe it doesn't work anymore. Or like to what extent does it stop working? And then there the explainability people that say, well we can actually extract uh this and that circuit or we can extract this and that representation. Like maybe one of the the best papers I I saw in like explainability was the paper about grokking where they ex where they extracted like the modular arithmetic.”