Models are improving substantially, and continue to improve, in reliability on factual mistakes, including egregious errors that could get someone fired.

“I would say that like we're starting to see huge improvements in the reliability of models as it pertains to factual mistakes, so the, the kind of egregious mistake that, uh, would get you fired, models are getting much better at and continue to get much better.”