Anthropic's systems still require substantial human expertise to operate and evolve at scale; Claude cannot yet independently make and safely deploy all required changes.

“Um, and so we've done a lot of work on how do we scale these systems, and that takes a lot of obviously just, like, distributed systems, expertise, and certain language and frameworks expertise that the models have, but when it comes to operating and evolving a system at scale like this, we're not quite- we're not nearly in a place where it's like, "Good luck, Claude.”

“Have fun, uh, and just go and kind of make all the changes you need to make to the system, roll them out safely, and operate this thing at scale."”

“Um, there's still just a lot of work for humans to have to do that I imagine will continue for a while. I'm curious how that's changed.”