The speaker believed he could not devise all the reward-function terms needed to train reinforcement learning to perform pen spinning correctly.

“Like, if I had to come up with this simulation environment,”

“the reward function for reinforcement learning to solve pen spinning,”

“that's impossible.”

“Like, I wouldn't be able to come up with all the terms that you need to get RL to learn the right behavior.”