causal claim
Tuning reward-function weights can very likely cause a constraint threshold to be exceeded accidentally, in part because the coefficients are difficult to reason about.
Alexander Mattick · Why Scaling Prediction Cannot Create Intelligence - Alexander Mattick · 21 Sept 2026
In their words
The transcript segments this claim was taken from
“And if you try to do this with like the the effective tuning, effectively there's a very high likelihood that you have accidentally something which goes above the the threshold. It's e especially since it's oftentimes really really difficult to think about these these coefficients. The second thing, uh the second big thing is you get”Play from 1:48:57Report a misattribution
90%how strongly it was put, not whether it is true
80%importance to the conversation
96%confidence the claim was read correctly