The speaker says that increasing model size somewhat over the previous couple of years has not yet produced the desired connection-making, though further scaling might help models notice more connections.

“maybe maybe so maybe second thing um have you tried making the model bigger uh they've made it a bit bigger over the last couple years and it hasn't worked so far maybe if they make it even bigger still it'll notice more of these connections and then third thing and here's here's i think the the special one have you tried training the model to do the thing you know just because like the you know the pre-training”