The speaker predicts AI labs will devote a growing share of compute to training, despite the increasing profit each additional unit could generate if allocated to inference.

“you're going to see them ratchet up their percentage of compute dedicated to training,”

“while each increment of compute is getting more and more profit generating if they had dedicated it to inference.”