Competitive pressures in a geopolitical race could make it difficult for the United States and China to durably remediate AI reward-hacking problems after serious incidents.

“how how do like how costly will that actually be how much will competitive pressures make it hard to like do that right so like a situation you could imagine is both the u.s and china are like whoa we have these crazy reward hacking incidents we basically know that we haven't remediated them in a way that actually would solve the underlying problem and will durably solve it but we're in this like insane geopolitical race and it's kind of unclear whether the current situation will lead to a takeover like the arguments are kind of complicated and also the incidents are like”