The speaker wants to maintain observability into a model's reasoning while still penalizing its bad behavior.

“this is like something that we really want to try to get the balance right on that if you like supervise the chain of thought then you could lead the model into hiding its intentions in a way that's unobservable so like we want to be able to maintain that observability of like okay we can understand what the model is thinking but then also punish it for bad behavior”