causal claim
Requiring models to reason over their own reasoning may eliminate many gains that reasoning models achieve when applied directly to problems such as math benchmarks.
Jack Hopkins · ⚡️Factorio Learning Environment: the ultimate Game Agent Eval — Jack Hopkins · 27 Apr 2025
In their words
The transcript segments this claim was taken from
“Asking the model to do reasoning over reasoning kind of eliminates a lot of the performance improvements you get from applying the reasoning models alone to problems like math frontier,”
“where there's a lot of benefit from just writing stuff down and figuring out what works.”12:29Report a misattribution
0.80how strongly it was put, not whether it is true
0.75importance to the conversation
0.94confidence the claim was read correctly