Ryan Greenblatt attributes the improvement in RL environments since 2024 mainly to better understanding of which environments to create and how to structure them, rather than to hiring many more human experts.

“The reason why RL environments today are much better than they were in 2024 is not that much because we have hired way more human experts to make RL environments. It is instead much more because we better know what RL environments we even want to make and how we should structure them.”