The speaker characterizes improvements from better web-data selection and processing as algorithmic improvements that can be developed through GPU-based study without human-expert training data.

“you know, open web text to fine web or whatever,”

“like that improvement is better described as a”

“say algorithmic improvement of the sort that you can you know study with some GPUs and then do and you don't need humans to like you don't need human expert data to do that now there's a different effect which we could talk about which is that maybe the internet in 2026 it has much more is more of a fertile ground for training data than like the internet in 2018 like it's like there's also been an effect where like there's just more humans posting on the internet so there's more data harvest my sense is that that effect is going to be you”