The speaker says on-policy distillation can delay, but does not prevent, the eventual problems caused by repeated model updates.

“just general capabilities um you know just on policy distillation seems to like push this horizon out a little bit but it still eventually succumbs to the same thing um and rl is not very good at like it is good at like getting capabilities in but it's not as good as getting like knowledge in and like just this very explicit knowledge of like okay like this person does this at this law firm and like this is a very specific process we find and you have to put in a lot of compute to create the right environments to get that”