The speaker says a single prompt cannot reliably contain all information for a complex business: LLMs may lose track of information in the middle of the context and hallucinate about it, including a return policy.

“And then when you said something like,”

“you can't put all of that inside a single prompt because it will like LLMs are.”

“you know goofy in that sense that always remember the first four percent and the last four percent and everything in between they kind of forget so if you have a return policy right in the middle of that context it's very likely it'll hallucinate so you have to do more smart things and that's where you have like more models come in you can have a compaction model like we're all using coding agents now right so you know like”