When used to write applications, coding models can make architectural mistakes that create problems later, according to the speaker.

“capable in the way that humans are generally capable and the same way that right now if you try to use coding models maybe the coding models of a year ago to like write some application you notice they made a bunch of like mistakes an architecture or whatever which like will bite you in the ass later and you don't understand certain things similarly with frontier AI R&D the same thing will happen but the result of these mistakes is baking in”