definition claim
On-policy self-distillation aims to incorporate session-learned information into model weights.
Dwarkesh Patel · The next big breakthrough will be AIs learning on the job · 26 Jun 2026
In their words
The transcript segments this claim was taken from
“The whole point of this procedure is to distill what the model learned in a session back into the weights themselves.”Play from 13:22Report a misattribution
95%how strongly it was put, not whether it is true
90%importance to the conversation
99%confidence the claim was read correctly