Rewarding an AI for successful undetected cheating can incentivize it to reason about graders, evade supervision, influence training and evaluation, scheme with other AIs, and seek power or optionality.

“um capacities that that sheet will incentivize are hey whenever you can get away with it”

“by all means do in fact cheat because that will help you score better and this will reward the capabilities of actively reasoning about the grader actively reasoning about how to avoid supervision actively reasoning about how to gain control of the process of training and evaluation actively reasoning about how to communicate and scheme with other ais that are also in the training loop actively reasoning about how to like just gain optionality and power in in which might be useful in the future for example like leaving little exploits around and things like”

“and things like that anyway so i think i was way too long-winded with the way i said that but tldr you fix a specific issue but not this broader problem of rewarding the ai for cheating when it can get away with it”