The speaker says effective reinforcement learning at scale requires pre-training because pre-training and reinforcement learning are tightly coupled, so both are needed.

“You actually do need to pre-train your model in order to make reinforcement learning work very well at scale.”

“So you actually kind of do need to do that.”

“The things are just so tightly coupled that you do need to do both.”