descriptive claim
OPSD does not require an outer-loop verifiable reward, provided a model can learn the relevant information within its context window.
Dwarkesh Patel · The next big breakthrough will be AIs learning on the job · 26 Jun 2026
In their words
The transcript segments this claim was taken from
“This is better than ROVR for two reasons.”
“One,”
“OPSD doesn't require us to have some outer loop verifiable reward.”
“We just need a model that can learn the right things within the context window.”13:28Report a misattribution
0.95how strongly it was put, not whether it is true
0.90importance to the conversation
0.98confidence the claim was read correctly