In the speaker's high-level account of RFT, each epoch generates four or 64 candidate trajectories per dataset example, which graders score from zero to one.

“But I think like, from our perspective at a high level,”

“the models,”

“each epoch, they're generating four or 64 different candidate trajectories for every example in your data set, the grader scores them zero to one. And then”