Language models internally reproduce many aspects of linguistics, although not necessarily the aspects Noam Chomsky would favor.

“language models sort of internally recapitulate a lot of parts of linguistics maybe Chomsky might be disappointed by the parts they recapitulate but that's too bad and but that's kind of a special case right because like it shouldn't be too surprising that a model like that a model that”