Tau-Bench provides deterministic evaluations, which the speaker considers a strength of the benchmark.

“You get a deterministic evaluation all the times that's the beauty of this and it's it's domain specific Which I think is missing from other evaluation data sets and that is also one of the themes for our v2”