Labs can run ablations by briefly training a model on a dataset and observing the resulting changes.

“And if it's too incapable or too capable, then it's not in the Goldilocks zone for the model to, to learn from it. Similarly, we would, um, do ablations where we'll take a set of data, train the model a little bit on it and see how things change.”