The speaker considers it exciting that different model families may converge on similar geometric representations of abstract structural invariants in the world.

“these representations for example geography you actually have some kind of geometric invariant of how the different countries in the world are related to each other and it's fascinating that that this would be convergent that different model families would learn similar types of geometry that represent abstract structural invariances of the world it's very very exciting but yeah I agree maybe we're reading too much into that we should move on to reward is enough and constrained”