The speaker says pre-training is a practically achievable way with available technology to create a starting point for reinforcement learning and related methods.

“It's like the practically possible version with our technology and what we have available to us to get to a starting point where we can actually do things like reinforcement learning and so on.”