descriptive claim
OPSD does not require an outer-loop verifiable reward, provided a model can learn the relevant information within its context window.
Dwarkesh Patel · The next big breakthrough will be AIs learning on the job · 26 Jun 2026
In their words
The transcript segments this claim was taken from
“This is better than ROVR for two reasons.”
“One,”
“OPSD doesn't require us to have some outer loop verifiable reward.”
“We just need a model that can learn the right things within the context window.”Play from 13:28Report a misattribution
95%how strongly it was put, not whether it is true
90%importance to the conversation
98%confidence the claim was read correctly