Allowing the kernel to change over time lets an analysis model feature learning in addition to lazy learning, but substantially increases analytical difficulty.

“And we have the uh kind of kernel itself describing the the local function. And this is also what mean field theory does. Mean field theory effectively in the c in the back of their their big paper, they have a a section where they talk about well actually the connection to neurotangent kernel theories, we just assume the kernel also changes.”

“over time. And that of course makes the analysis way way better that you can now effectively also model not only the laser learning but also the feature learning domain. But has a huge limitation now that it becomes much much harder to analyze.”