The speaker thinks combinatorial analyses of deep learning can characterize learned-model complexity but generally provide limited insight.

“to actually look at what what the mathematicians are doing, like all the combinatorics people they all say, well that looks like something I can do. And ultimately there are really really interesting things there as well. But I don't think they give you that much insight. They can give you statements like okay, what's the actual complexity of a learned model?”