The speaker considers it uncertain whether universal convergence would mean that a model trained long enough on its own inputs and outputs would reproduce a mind; he finds the possibility mind-blowing and says it may not hold.

“And the deep question is- At which level does this stop? If you, the universality hypothesis would be universally true, right?”

“It would mean that if you train a model on your own in input and output, and you train it for long enough, you will wake up inside of that model. And it's a quite mind-blowing idea to me, and I don't know if that is actually the case, and there might be a reason why it's not the case.”