When data is scarce, introducing substantial inductive bias may be necessary to achieve enough statistical power for reliable inferences.

“Um, so that's like the one and then-- But then there's this like countervailing tendency which is like maybe you could call it the anti-bitter lesson or like the other, the flip side of the bitter lesson where when you're in data poor regimes, for one thing, then you, you have to induce-- introduce a lot of inductive bias to get enough statistical power to make good inferences.”