The speaker's team is developing evaluations intended to predict how well a model can automate work in a particular profession.

“Um, and so all that to say, like, one of the things that my team is working on currently is to try to build a much better eval that actually predicts the ability to automate the work of that specific profession.”