In semi-verifiable domains, it is generally straightforward to score a blank output as 0% and a perfectly completed output as 100%.

“Yeah. So creating the rubric is by far the most challenging part of, you know, these semi-verifiable domains. Generally, it's very easy or, or, or straightforward to say like this output is a 0%.”

“You know, they return absolutely nothing like a blank page or fa- okay, under- understood. Or this output is 100%. Like, oh, they, they nailed it perfectly and I, you know, I would, I wouldn't change anything.”