The speaker says widespread distillation from Claude makes open-weight models resemble Claude and share its stylistic ticks, creating a concerning model monoculture.

“um so there's actually um it's not like you're getting the same kind of diversity that you get when you like from human authors you're sort of getting one really good uh like style so i think that um like that kind of diversity has definitely been like cut down by rl a lot and in fact uh now oh yeah since we were talking about distillation earlier that's sort of something yeah one thing that's happening is that so many people are distilled”

“distilling mostly from Claude that like like all the open weight models right the same way as Claude and use the same like have the same ticks so this seems kind of concerning to me that we're having this like this monoculture emerge”