The speaker says retrieval and aggregation tasks may differ greatly in domain and in the trajectories of a regular language model, while sharing similar solutions.

“is very similar across like tasks where you don't even like it's not even that clear to you that the solutions are similar so in this example we have like a retrieval task and we have like a an aggregation task and they're very very different query like the domain is just completely different and when you train a regular language model over these two tasks the trajectories look very different and so what you're relying when you like let's say you use pi or”