The speaker does not know how to answer or scientifically formulate whether language models internally represent general relativity.

“works on natural language has internalized at least some abstraction for natural language processing like perhaps the surprising thing is that it's similar to ours in some ways or like the abstraction that humans have developed but the question of like to what extent does it represent general relativity I don't actually know how to answer that I don't even know how to frame the question in a”

“in a way that I could ask it scientifically.”