Richard Socher says combining prompt engineering, transformers, and language models and scaling them up led to substantial progress in AI.

“and to me that was like a really a big step forward and then of course you had to combine this idea of prompt engineering with transformers and with language models and you put it all together you scale it up which is also a huge amount of work and then the field progressed a lot I feel like the next step and maybe the last step of that history and the sort of arguably sort of success has a lot of parents only failures and often like my version of that”