SPEAKER_02 characterizes Rich Sutton’s “Bitter Lesson” as arguing against building knowledge and constraints into systems and in favor of scaling models of computation.

“Yeah, I suppose this is the other vexed issue with our friend Rich Sutton is that he has this bitter lesson essay,”

“which is basically that he doesn't think.”

“that we should be building knowledge and constraints into the system he thinks that we should just scale you know models of computation and I'm a big believer that constraints are incredibly valuable and by constraints you know more broadly I'm just talking about knowledge I think constraints happen at multiple levels of abstraction so in the physical world constraints might just be the laws of physics or whatever and and in our minds the constraints might be things that we already know and this guy Chris the other day he was saying to me that one of the amazing”