Refusal behavior should not be made too strong, because overly strong refusals would stop the model earlier in the pipeline.

“there are few failure modes right like it can again do something as a side effect right so it's not something that's part of the final output uh you might have noticed that like i think like everyone's tried to jailbreak models and sort of like you know try and like steer them off course or things like that and probes help catch that right and so like we like do some training here but we don't want the like refusal to be too strong right because that like cuts it off much”