The speaker says neural-network training derives gradients through recursive applications of the chain rule, enabling optimization of arbitrary differentiable functions.

“regards 100 lines can easily understand it you're training it's a recursive application of chain rule to derive the gradient which allows you to optimize any arbitrary differential function so it's a i love finding these like”