The speaker agrees that observers may be overinterpreting similarities between model representations.

“these representations for example geography you actually have some kind of geometric invariant of how the different countries in the world are related to each other and it's fascinating that that this would be convergent that different model families would learn similar types of geometry that represent abstract structural invariances of the world it's very very exciting but yeah I agree maybe we're reading too much into that we should move on to reward is enough and constrained”