At a possible equilibrium, reward hacking may be infrequent enough to permit widespread AI deployment but frequent enough to cause serious incidents.

“over time in the world increasingly severe and extreme reward hacks though potentially the rate remains at some like intermediate low level where basically like if the rate of reward hacking gets too high companies make trade-offs to drive down the rate of reward hacking and so there's some like equilibrium level where it's like it's like the reward hacking is low enough that it still makes sense to like deploy the ai widely into the economy but high enough that it still causes crazy incidents”