Some effects of training data are apparent from reading examples, but very large datasets are hard to inspect and model-learned behaviors can be unintuitive.

“And sometimes the things that you learn are kind of obvious from reading the data.”

“it's just not clear what in fact is in your data when you have like just just enormous quantities of it you're like i don't know what's in there you can't check it or maybe you could run an llm over it but then the problem is like um the”

“the process like what a model learns from data”

“will sometimes be intuitive to you like the pirate example is quite intuitive that the model should learn to be a pirate um but sometimes it's like deeply unintuitive like emergent misalignment um that was a deeply unintuitive finding to most people um i think i”