Controlled generalization involves learning selected aspects of training data while excluding other aspects.

“taking only some things from the data and not others and so the thing that we want like a very simple example of this is you have some data that will make the model somewhat better at math but you've also kind of corrupted it in some way and in this you know we decided to use like talk like a pirate and then”