The speaker suggests that preventing an initial hallucination may help a model infer that it should provide factual answers rather than make things up.

“so it might be that we're just sort of making the model really confident by like we never let the first hallucination in and that allows the model to become confident that oh no we're playing true facts today we're not like making things up yeah”