In the speaker's team's experiment, models were often poorly calibrated, reporting maximum or near-100% confidence even when their answers were wrong.

“Just self-report its confidence. You know, nothing mathematical here. Totally vibes-based, based on the model's intuition. But yeah, we find they're notoriously uncalibrated, and they often say they're m- at max confidence, uh, basically near 100, and the answer is wrong.”