A model that generated a hallucinated answer can sometimes recognize that answer as a hallucination when explicitly asked to assess it.

“it will sometimes be able to pick it up um literally the same model that just hallucinated will be like oh if you ask it it'll be like oh that is a hallucination um and it might be that like this is actually a very hard thing to supervise you know if you try and supervise like if you this is like a hard and expensive thing to just put into a into training supervision um an interesting kind of mechanistic hypothesis for this um”