Generating challenging evaluation scenarios took substantial time; the speaker used a strong model to create scenarios and tested whether that model could complete the tasks.

“that I have spent a lot of time was generating hard scenarios because you take a hard more you take the best model to generate hard scenarios and you then see if the best model can accomplish those tasks or not like let's say I generate by 3.7 and then check on 4.1 and then it's able to accomplish so I had to kind of do a lot of iterations on like finding where the model fails and how to trigger this kind of scenarios”