RFT graders can be based on string matching, regular expressions, fuzzy matching, unit tests, Python code, or an LLM, and several graders can be combined into one.

“these programmable graders these scoring functions right they'll output a score of zero to one and the model learns to kind of hill climb and try to maximize these scores using rl right so with the api it starts with a grader right and there's different types you could try like string match you could try regex you could do a fuzzy match”

“Often you could do a unit test,”

“run some Python code,”

“or even use an LLM grader, or even combine a bunch of graders together into a massive grader, you know, kitchen sink.”