In version 1 of the benchmark, scores were saturating and the best score had reached 0.95.

“as unbiased as possible then we saw with v1 that the scores are saturating we see that the best score has already reached 0.95 and so if we are going to evaluate even better models that are coming out they'll be definitely in the range of 0.9 to 1 which i feel is not very informative for anybody to take a call because there can be some noise also in this evaluation so we want the benchmarks”