The consciousness program is not guaranteed to converge in the same way as representations in language models and might instead be divergent.

“I mean, assuming you're right about the convergent representations in, in language models, I guess it's not a foregone conclusion that the consciousness program would be convergent in the same way.”

“It might be divergent. And how far down the stack does consciousness go?”