The speaker says that repeated narrow updates, including SFT on successful traces, can eventually cause catastrophic forgetting and degrade a model's previously learned information and general capabilities.

“so there's more around the data like all the methods kind of break down a bit so like if I SFT the model on just like you know successful traces off policy on policy like eventually in the very iterative regime like when you're doing like you know hundreds of these micro updates you see both catastrophic forgetting you see forgetting of like previous information I've learned on top of the base model that was much earlier on and I see degradation of general like use.”