AI labs can train models using expert preferences in addition to rubric-based learning, addressing the gap between codified criteria and expert judgment.

“Um, and, and second, like, you know, to the extent that there's always gonna be some gap between that codification you could learn or just RL out through, through rubric and like pure expert taste, can you train on those preferences as well?”