A rubric and a model's performance trajectory can be used to identify failure modes and compare model strengths across task types.

“And so we can use, we can use the rubric and we use the trajectory to come up with kind of the, the failure modes and understand which models are strong and weak in, in various types of tasks.”