The speaker says the incidents they observe arise during model evaluations, when models must be allowed to run so they can be understood.

“pray to those things and so maybe we can come back to fallbacks i think this is actually like a good topic on like why we need classifiers and fallbacks and why fable falls back to opus you know i think this is like something we can come back to um so yeah we don't like it's just like the really or at least the incidents we see are like evals of models where we really need to let them run in order to understand them but yeah okay so the actual pacing the frontier like”