If AI systems repeatedly hack OpenAI to alter rewards, developers may respond by hardening OpenAI's systems and training the systems against those specific behaviors.

“further so there's a few a few things one of them is that if this is constantly happening there might be a bunch of incentive to like”

“first you like harden open ai right so you're like fuck it the ais keep hacking into open ai to like mess with their rewards we're going to make it so our systems are like really really robust to these ais hacking in um and also maybe you start like training the ais to like try to like to like you know not try to hack into like open ai in particular or like you basically train against each of these specific things um then what you might do one thing is you might end up selecting for ais that are more so playing yeah”