Models should learn sound safety judgment during training instead of relying solely on inference-time protections against unsafe requests.

“Instead of just thinking of model has been built and now we want to protect, uh, unsafe requests at the, at the inference time. The model should have a good judgment of what safe looks like right at the training time.”