The speaker says that when asked for a joke, ChatGPT may produce only a few familiar jokes rather than representing the full diversity of possible jokes.

“of sort of thoughts about content so the llms when they come off they're what we call collapsed they have a collapsed data distribution if you sample one easy way to see it is go to chat gpt and ask it tell me a joke”

“It only has like three jokes.”

“It's not giving you the whole breadth of possible jokes.”

“giving you like, it knows like three jokes.”