A model may need to infer from conversational context whether it should generate fiction or provide factual information.

“is to do with this idea of like also personas or kind of in context learning because being able to make things up is actually a useful like useful capability for a model like if i ask it to write a story yeah if i wanted to generate a fictional world for me it's actually not a very good fictional world if everything is factually true so being able to make stuff up is a useful capability for a model and sometimes it has to figure out in context that this is what we're doing so if you imagine from sort of”

“I'm not quite sure what task we're doing.”

“um you know are we making stuff up are we saying factually true things um and everything that i say and everything the user says is some amount of evidence one way or the other and then if i say something incorrect then like i'm now taking this as evidence that oh we're making things up cool let's carry on um and in fact we show that like just doing these in context interventions is already enough to reduce for like downstream hallucinations”