Benchmark results can guide labs toward improvements in model steerability and may indicate where more training data is needed.

“Having the eval there to be like, "Hey, um, you know, we gotta get better at surfacing these tax treatments" or whatever, whatever ways those manifest. There's tons of those examples, right?”

“Um, it can certainly help you direct where do I need to improve steerability of the model? Where do I need to improve, you know, where might I need more training data? Where might I need, you know...”