The speaker does not see how reasoning that improves optimization of the current objective generalizes to discovering the right objective in the first place.

“like there's many many good examples where if you just thought about it a bit more you would have been able to like cut down a significant on things that you've done so like mu p and like how learning rate scales with like model size and like realizing that model width is important in that as well um like i feel like you can you can really back out a lot of these things and cut off like a lot of low-hanging fruits i would imagine like a 10 times speed up if our thing is just like maximize the objective we're currently on but i don't see that how that generalizes at all to”

“you know come up with the right objective in the first place like just thinking doesn't necessarily buy you the right objective in the first place”