The speaker agrees with LeCun that contrastive models should be left behind because contrastivity alone does not provide a strong enough objective to ensure useful learned models.

“Um this of course adds a little bit of noise, but tends to work pretty well. But fundamentally I agree with Lecun that we need to go back away from these contrasted models, because contrast contrasitivity alone is not strong enough of a statement to uh to actually learn necessarily useful models. So what Lecun all says is well, we should actually go effective, we should revisit old ideas, which is try to map things in”