Training models to detect hallucinations may be difficult and expensive to supervise.

“it will sometimes be able to pick it up um literally the same model that just hallucinated will be like oh if you ask it it'll be like oh that is a hallucination um and it might be that like this is actually a very hard thing to supervise you know if you try and supervise like if you this is like a hard and expensive thing to just put into a into training supervision um an interesting kind of mechanistic hypothesis for this um”