The speaker considers it doubtful, but not impossible, that AI systems will overcome their dependence on humans to frame their goals.

“specific program in there you can get it to do a specific thing you can get it to hill climb towards a specific goal to solve a specific problem but the framing always comes from us so it's it's kind of doubtful whether we would overcome that maybe we will but it's kind of doubtful but but but then there's this thing which is the the first or second step fallacy right which is uh as you said Eliezer Yudkowsky he said there were only one or two steps away from inventing AGI and it's going to run away”