When a feature is incompletely ablated, other layers can compensate, and gradient descent can route around the intervention.

“and so if you ablate them you know if you like incompletely ablate them the other layers will just pick up the credit and the model like gradient descent will like root around the problem which is why i think things like positive preventative steering are much more much more or inoculation prompting are kind of more more in line with the way to go because they're what they're doing is they're sort of”