The speaker says large labs and closed-model developers already perform a slower-cadence form of continual learning, rather than necessarily updating an individual model live after every experience.

“I completely agree I think if you zoom out far enough this is like definitely happening like you're picturing this like and we're all picturing this is like what continual learning like the holy grail is is like this very very organic like live loop of like an individual model like”

“or like getting an experience and like live updating on the spot and learning from that and like a lot of things break when you like zoom into that level of granularity but like yeah the big labs are doing this like the closed the closed models are doing this there's also early signs of life of like people using open source models doing this at a much faster cadence so”