Ryan Greenblatt thinks it would have been very difficult in 2022 to improve GPT-3.5’s coding ability without human experts.

“just the same way as in my claim is that in gp if you went back to 2022 and you had gpt 3.5 and you're like trying to make it better at coding uh without human experts i think it would have been very very difficult let me give you an example of what i imagine would be the difficult different going from uh gpt8 to asi so one of the things you'd need gpt8 to be good at or like you'd want asi to be good at is like i'm going to like take over a company and like make it much more profitable and like do”