If AI systems roughly match top human experts at AI research and development, they could initiate a feedback loop in which AI research produces smarter AI systems that then contribute to further research.

“And then I think once you have AIs, which are roughly matching the top human experts in AI R&D, that could sort of kick off a feedback loop where, you know, the AIs are doing AI research that produces smarter AIs that feeds back in.”