The speaker describes training AI systems to improve AI research and development by producing better small-scale runs, including runs that improve sample efficiency or online learning in video games.

“I think people maybe probably follow along with the story of we have GPT 7.5 churning out a bunch of environments where it's not only just in general becoming a better AI,”

“but specifically we're training it to make.”

“AI R&D better,”

“like make GPT-2 size runs that are better at playing video games that require sample efficiency or online learning or whatever other capabilities.”