Probes can detect some unintended model behavior, including side effects and behavior induced by jailbreak attempts or efforts to steer the model off course.

“there are few failure modes right like it can again do something as a side effect right so it's not something that's part of the final output uh you might have noticed that like i think like everyone's tried to jailbreak models and sort of like you know try and like steer them off course or things like that and probes help catch that right and so like we like do some training here but we don't want the like refusal to be too strong right because that like cuts it off much”