The speaker expects that better models evaluated on the saturated benchmark would score between 0.9 and 1, making results less informative for decisions because evaluation noise could affect them.

“as unbiased as possible then we saw with v1 that the scores are saturating we see that the best score has already reached 0.95 and so if we are going to evaluate even better models that are coming out they'll be definitely in the range of 0.9 to 1 which i feel is not very informative for anybody to take a call because there can be some noise also in this evaluation so we want the benchmarks”