The speaker says longer-form generation tasks evaluated with an LLM grader can be vulnerable to reward hacking.

“In the physical exam use case, we can kind of talk about that, but we used an LLM grader for the first time and whenever you're using like an LLM grader, the task is like a little bit more pros or a little longer form generation, you could be very vulnerable to this.”