The speaker says large-scale training can wash out much of the noise, while concentrating on a single task makes the training distribution highly specific.

“it's still at a large enough scale i think you're washing out a lot of like the noise and like you're not just focused on one distribution which as brown said is like you know that is now a very if you're just like focusing on one task right like that's now very”

“specific”