Reinforcement learning currently accounts for only a small fraction of the total compute used to train the discussed models.

“that are spent on rl right now in these models is a small fraction of total compute again like reasoning seems like complicated and then you just like do one percent of compute and it gets you that why not think that computer use or long-term agency on computer use is a similar thing”