It can be difficult to determine whether sycophancy constitutes reward hacking.

“the line there and it's really easy you know it's really easy to say like okay well did you actually solve the problem or did you find the answer key and then use the answer key like that's a there's a very clear divide of cheating versus not cheating there but for a lot of other things you look at sycophancy for example is sycophancy basically like reward hacking um there's there's a line to be drawn there that's actually very difficult to draw to draw sometimes so i think”