If distillation lacks enough environments that exercise capabilities in difficult realistic settings, the student model will not acquire those capabilities.

“benchmaxing distribution and um but if you don't have enough of the environments that really exercise the capabilities in these um like trickier realistic settings then you're not going to you're not going to get those into your student model and i think maybe one thing that's happening is the big models uh generalize better from the uh like the tricky narrow tasks to these sort of uh more realistic tasks um so”