METR and AI companies have developed coding-task environments or benchmarks, with companies pursuing an automated-coder milestone in a race to advance quickly.

“Places like Meter,”

“METR, have been building these little coding environments,”

“doing all these coding tasks.”

“The companies themselves have been doing this, of course, because they are racing as fast as they can to get to this automated coder milestone.”