Companies should aim to benchmark coding-agent systems; the speaker's company finds benchmarking useful internally.

“But the other thing that is, um, you know, I think companies should strive for that we find very useful internally is like the ability to actually do what we call benchmarking.”