At a basic level, model developers already use deployment data—sometimes filtered, judged, annotated, or synthesized—in pretraining or mid-training for future model generations.

“like at a very basic level, this is already happening,”

“just in the next generation of models so like right now you can obviously take your deployment data and put this in the pre-trained or the mid-trained of like future models especially if you do like some kind of filtering or some kind of like judgment or annotation or like recent you know synthesis of that i”