The speaker characterizes AlphaGo's Move 37 as innovative rather than inherently creative, though it appeared creative to people who understood the relevant creative space and its structure.

“problem in reinforcement learning that you know when it found move 37 it was kind of innovative but not creative it was creative to us because we understood the creative space we understood how it all hung together and now with these RL trained language models they don't understand it quite in the way that we do but they solve the exploration problem by understanding how things fit together so they can just explore novel trajectories they have a lot of base knowledge they clearly do things”