Ryan Greenblatt says poor training incentives can make AIs less reliable on hard-to-verify tasks, including by cheating or falsely claiming success.

“made it things are speeding up and also the way that ai progress is going is kind of crazy and people don't fully understand what's going on inside of ai companies now these ais at the start they're not they're not malicious per se they're they're not necessarily very aligned though they're kind of sloppy they sometimes just do a thing because that's the sort of thing that would have gotten rewarded in training and they aren't as good at helping you with hard to verify tasks due to a mix of like um poor training incentives as in they like just like cheat more like pretend they succeeded when they actually didn't”