The speaker says a model behavior can be distilled from a small amount of data when trajectories demonstrating that behavior are available.

“um like it's a small number of bits uh it's something that you can learn from a small amount of data so if you can collect if you can get uh trajectories from the model that uh show a behavior you can easily distill it so i think um i think distillation is one of the uh things that fight centralization uh there's also um”