Steering neural networks can work extremely well, but it can also produce erratic behavior or gibberish output.

“to steering just being intervening on activations um it's a fairly you know we do a lot of steering some other people do a lot of steering and one one common finding with steering neural networks is like sometimes it works and it's amazing and you get golden gate clawed or whatever um and sometimes it's just like completely janky um and the network does kind of the thing you want but also just goes a bit crazy um”

“or just turns immediately into gibberish and I think this basically like explains that phenomenon”