Pre-training consists of showing a model a large amount of data.

“And those things are very dangerous to post-train the model on because the way, the way-- Just to, like, take a step back and talk about training, there's pre-training, where we are just taking a lot of data and showing to the model.”