Models' training corpora contain far less data than scientists process, in part because scientific papers often include only representative samples.

“And you may have like some representative samples shown in the, um, papers themselves, but the training corpus that the models are actually handed is very, um, constricted compared to the amount of data that scientists are actually processing.”