The speaker thinks high-level abstractions can be brittle.

“And then what we tend to do as we walk up the abstraction mountain is we get these increasingly domain general representations that could apply in novel situations. Sometimes I think having high abstractions are quite brittle,”