The speaker describes achieving low sample complexity as the holy grail of machine-learning research.

“You know, that's called sample complexity in machine learning. That's the holy grail of machine learning research, to get low sample complexity. When people talk about recursive self-improvement, they're talking about, uh, AI inventing new ideas typically to bring down that sample complexity, better architectures.”