The speaker says that because finance is high-consequence, benchmark performance alone is insufficient when users cannot inspect a system's live behavior.

“Um, 'cause finance is just such a high-consequence industry that if you can't build... You know, if you can't inspect live what is actually happening, doesn't matter how well you perform on benchmarks.”