Joscha Bach says assessing whether an LLM has conscious experience requires mechanistic interpretability to examine whether its internal structure is causally equivalent to the mind structure that produces the same output.

“And that, that is really the problem that requires some kind of mechanistic inter-interability where we would actually need to look into the structure of the LLM to find if it's causally equivalent to the structure of the mind that is producing the same thing.”