The current approach to AI improvement retains the existing model lineage and converts recently discovered training-stack bugs into environments for further frontier training.

“yeah yeah maybe maybe just what i think about this is like how much of the lineage we roll back and then let self play from there like i think in the limit like you're picturing like you know just giving them like a gpu and maybe neural nets or something and saying like okay figure out how to train a model to like do this particular task like the way it currently works is like we go up to the very like edge of the of the lineage and say okay like here are the bugs like you know anthropic is”

“because found in their training stacks in the last few months will turn those into environments like you need to train and get better on the frontier and so you obviously lock in all the previous history of the lineage but you could imagine a world in which you roll back to like you know before grpo or something and then you have environments which like trying to get it to discover like the best form to like rl models”