The speaker suspects calibration is underused because people use models as fast classifiers without using their probability, calibration, or confidence estimates.

“actually I think calibration is probably the under like people are just using it as a very fast classifier but they're actually not even using the probability or calibration estimates or confidence estimates”