The speaker says the EdgeBench paper found that models’ ability to work for longer durations roughly doubles every three months, and regards this as clear evidence of generalization.

“there's a paper called edge bench which showed that the rate at which models can work for longer is like doubling every three months and so that's a clear evidence of generalization and i think like the final way to think about is like um in pre-training there's this idea of like”