The speaker says financial evaluations were forthcoming, but at that time there was no good way to demonstrate progress on financial tasks with them.

“They're coming. Um, but it was-- there was no good way for us to show progress, uh, on financial tasks on these evals. Um, there's a funny, like, funny things. Like, I think there's this bias in evals where if the numbers look good, the researchers assume that the model's gotten better, and they don't investigate it.”