The speaker says that, in retrospect, correctly handling implementation details and practical intuition has often been a major bottleneck to AI breakthroughs.

“of like taste about in the weeds experiments that they currently don't have and need to have a bunch of intuition for like what sorts of training approach would work and what wouldn't work in ways that current researchers have and even in cases where there has been some breakthrough in AI oftentimes in retrospect it looks like a big bottleneck to making that breakthrough happen with sort of getting all of the like micro details and mungy intuition right like an example of this is”