Many major AI innovations, including those related to the Chinchilla scaling law, focused on using compute more effectively.

“Or things like the chinchilla scaling law. And so many of these big innovations were just...”

“about how to harness your compute more effectively that also tells you that actually the scaling of compute might be very important and I think there's just like many pieces of evidence that points towards this complementarity picture so I would say that not only like even if you assume that experiments are not particularly important the evidence we have both from estimates of AI and other software although the data is a bit”