The speaker says evaluating model creativity requires a new reward function that measures creativity and domain-specific knowledge to design that reward.

“increase uh but then you also need to uh have the the taste like right you need to know like which direction is right like this is a common problem in aisle and so i would say uh you need a new way”

“like you need to define a new reward function to kind of”

“capture how good this model is in terms of creativity and and just like in it times you need like specific domain knowledge to kind of create this reward”