The speaker estimates that humans may encounter roughly one million times as much data from birth to adulthood as a model encounters from cold start through training.

“Like plausibly a million fold behind humans in terms of how much data humans sees from birth to adulthood versus how much a model sees from, you know, like cold start to like finishing training.”