The speaker says circuit-based explainability analyses often assume routing stays constant under permutations, but that assumption is false.

“But it would also push back against all of these ex explainability techniques. Because generally speaking they are th they're not very robust. Like they make firstly they they often make like extremely simplifying assumptions. Like let's say like the the circuit um uh people like they uh like the the transform of circuits but they usually make the they usually make the assumption that the actual routing is constant as you change kind of as you permute your uh your”

“Yeah, that's not true.”