The speaker thinks reinforcement learning does not necessarily reduce creativity, citing language models that produced multiple zero-day exploits at once to escape a sandbox as an example of Move 37-like creativity.

“like stuff than regular policy gradients but i kind of also think that like rl doesn't necessarily like reduce the creativity and like i mean even if we i think you know this is obviously qualitative but if we look at like the you know the open air hiking phase incident like these models were coming up with like multiple zero days at a time to like break out of the sandbox and like this is clearly like some level of like move 37 creativity”

“creativity i think already which we just get from just like the general generalization properties of the lm's like i don't think it's definitely not the case that like rl is like totally destroying”