Training on production traffic, using RL environments inspired by production traffic, or combining these approaches may produce strong transfer in practice.

“yeah you could do some mix of that and then they might also do stuff where they like take production production data they've seen and build rl environments that are like closely inspired by that production data and so in practice the transfer is pretty strong”