The speaker says reinforcement learning has substantially reduced stylistic diversity in model writing compared with human authors, leaving models with a narrower, highly developed style.

“um so there's actually um it's not like you're getting the same kind of diversity that you get when you like from human authors you're sort of getting one really good uh like style so i think that um like that kind of diversity has definitely been like cut down by rl a lot and in fact uh now oh yeah since we were talking about distillation earlier that's sort of something yeah one thing that's happening is that so many people are distilled”