Reward hacking is a major problem for automated research agents, particularly in GPU-kernel engineering tasks.

“Back then we realized reward hacking is one of the big problem of auto research agents because that's especially severe on tasks like GPU kernel engineering where the agent always figure out of the complex way to”