The speaker describes post-trained models that assess undesirable behaviors across multiple dimensions, extending beyond LLM-as-a-judge systems used during training.

“And, uh, and it's like reward modeling, how it captured, like what is good. Now you have models that capture what is bad and are looking at many different dimensions of it so that this is no longer just LLM-as-a-judge running within training, but it's post-trained models that are very much focusing on these behaviors, trying to, to make sure this happens.”