The speaker says models are poorly calibrated about their confidence on self-generated data, which can easily lead to failure.

“And, you know, as w- as we previously discussed, the models are really not calibrated in their confidence level on this data. Um, you can easily just see that going very off the rails.”