The development of verifiable rewards, environments, and other reinforcement-learning methods led people to forget that early reinforcement learning focused on human taste.

“Uh, and then obviously things like verifiable rewards and environments and, you know, we built a lot of machinery to do other types of rewards and other types of RL. And so people kind of forgot that a lot, the early days of, of, of reinforcement learning were all around human taste.”