Companies should evaluate both their own models and available models against benchmarks to determine deployment readiness or identify when to escalate work to humans.

“And then, um, test both the models that they build, the models that are out there, all the suites of options that they have on these benchmarks to then be able to prove to themselves that it's ready for deployment or find right escalation paths to the humans in between.”