Major AI labs are primarily betting on autoregressive models as the field moves toward increasingly multimodal models.

“primarily like all the big labs are kind of like betting on the same architecture autoregressive models and as we move towards more and more like multimodal models and kind of like there is this idea that maybe we'll have a model that can handle all modalities and we'll know everything about the world”