If simulation-to-reality transfer is insufficient and models need weight updates from real-world interactions, their low sample efficiency may pose a deeper problem.

“in order to get better at them and then if that is the case if transfer isn't strong enough and you do need weight updates then the fact that the models are quite sample inefficient is like maybe a deeper problem and the reason i'm curious about this”