The speaker distinguishes innovations that cumulatively extend the current AI paradigm from a fundamental shift that might require abandoning gradient descent and neural networks.

“we have the answer that we kind of have the ability to implement it but like maybe there's the distinguish we should distinguish between a discontinuity which adds to the current paradigm again it's like cumulative like there's something beyond the rl that we have to discover maybe they're capable of like you know connecting the dots in that straight line or like like again how far off the global optimum are we do we have to”

“We have to go back and throw out like, you know, gradient descent and like neural nets in general.”