The speaker says that critics have repeatedly treated limitations of current LLMs as fatal to the paradigm, only for newer LLMs to overcome those limitations a year or two later.

“So I think there's a long and sordid history of people looking at some limitation of the current LLMs.”

“making grand claims about how the whole paradigm is doomed because they'll never overcome this limitation and then like a year or two later uh the new llms overcome that limitation um and i would say that like with respect to this thing of like why haven't they made these interesting scientific discoveries by combining the knowledge they already have and like noticing interesting connections i would say first of all you”