The speaker's lesson from large-scale machine learning is that, at some point, data outperforms human-designed concepts added to models.

“So I think in our case, these hybrid models might be still the thing to go for. But more and more, of course, and this is I think this, I don't know if you can call it sad, but the honest learning from, from big scale machine learning is that at some point data beats human-made additional concepts in these models.”