Treating a structured representation manifold as Euclidean and interpolating between points can move the representation off the manifold, where the image model produces garbled output.

“um intervening right on those activations so you can move the car to a different location on the string and lo and behold you've now moved it around but the really important concept though is that this this is a manifold so as you were saying before like the the manifold kind of represents the the meaning of of this particular thing right and if if you if you treated it as a euclidean space and you just sort of interpolated between two points and you and you”

“And you went off the string,”

“you're now in no man's land”

“from a kind of representations point of view.”

“So now the image model is just going to be garbled.”