In a 2021 blog post, the speaker considered possible large training runs using 10^36 floating-point operations and estimated their likelihood of success.

“well what could we do with 10 to the 36 and you can lay I wrote a blog post about this in 2021 you know suppose we had 10 to the 36 flop what are some like really huge types of training runs we could do and then like what's our guess as to how likely that is to work and what you can do is you can sort of”