Some methods that appear not to work theoretically can work in practice, especially in reinforcement learning, where repeated optimization can eventually find a workable solution.

“And there are plenty of other things where still like it doesn't on paper doesn't work but in practice it just works because especially reinforcement learning it just it hammers on it until it figures out something and I think that many many things right now are like this like they are not necessarily optimal but they're also too bad to actually bother fixing it.”