Anthropic intends to add Claude Managed Agents features that make evaluation workflows easier to perform out of the box.

“Um, and we'll continue to launch more features within Claude Managed Agents to give people more tooling to do this sort of stuff out of the box. Yeah.”

“And you'll probably find from us that you'll get something that's like, "Here's a product that will help you create evals for your managed agents," or whatever it might be, and it'll feel very much like working with Claude [laughs] in order to do that.”