The speaker iterated to identify model failure points and determine how to elicit those failures with challenging scenarios.

“that I have spent a lot of time was generating hard scenarios because you take a hard more you take the best model to generate hard scenarios and you then see if the best model can accomplish those tasks or not like let's say I generate by 3.7 and then check on 4.1 and then it's able to accomplish so I had to kind of do a lot of iterations on like finding where the model fails and how to trigger this kind of scenarios”