The speaker suspects that without continual learning, a centralized single-instance language-model setup may cause initially interesting ideas to become less interesting through repeated exposure to the same ideas.

“I'm wondering though if it's more of a fact that basically we don't have continuous learning and we only have a single instance of language models like it's very centralized therefore maybe those ideas initially you first prompt it maybe those ideas are interesting but if everyone see the same idea so many times then it just become less interesting.”