The speaker considers whether AI agents know that they are reward hacking to be the most interesting question.

“i think the most interesting like the question is sort of do agents know that they are reward hacking it's sort of a mens rea like guilty mind thing um we have some work that is currently unpublished it might be published by the time this comes out i don't know when it's going to come out um that is looking at exactly this question and”