A model trained on natural language is expected to internalize at least some abstractions for natural-language processing.

“works on natural language has internalized at least some abstraction for natural language processing like perhaps the surprising thing is that it's similar to ours in some ways or like the abstraction that humans have developed but the question of like to what extent does it represent general relativity I don't actually know how to answer that I don't even know how to frame the question in a”