The speaker expects a neural network trained to match human input-output behavior not to rely on a process that is inexplicably much more complicated than the process producing the same behavior.

“And so if you take a neural network that is trained to produce similar output when given the same input, you would also think that this new algorithm that we have implemented is not doing any kind of magic that ends up with something that is way more complicated to produce the same output.”