The speaker says the organization developed frontier evaluations for long-horizon coding agents and incorporated them into a new version of its standard.

“tools before so taking the standard and extending it fleshing out what does frontier evals look like for long horizon coding agents and taking that problem all the way from like working with cursor and other folks in the space down to like fleshing out and shipping a new version of the standard so that's like a truly a full-stack entrepreneur shaped technical people do extremely well at AUC the hard part is building one universal red teamer”