The speaker’s heuristic is that compute requirements increase by roughly four times for each model generation.

“Think about it as for every generation of model there's a 4x multiplier in compute roughly and one heuristic that I have is like”