Recursive self-improvement is typically discussed as AI inventing ideas, including better architectures, to reduce sample complexity.

“You know, that's called sample complexity in machine learning. That's the holy grail of machine learning research, to get low sample complexity. When people talk about recursive self-improvement, they're talking about, uh, AI inventing new ideas typically to bring down that sample complexity, better architectures.”