The speaker expects future ideas to produce more efficient training methods that require less compute.

“but now we're also going to get new ideas.”

“And so as new ideas come along,”

“we're going to be able to come up with more efficient methods that allow us to train it with less compute. So you can think of.”