Richard Socher says language models can already code very well.

“I think they're underestimating still the ability for these models to code and code is neurosymbolic reasoning and these models can obviously code incredibly well and so I do think there are of course more and more ideas that will will be needed and will continue to have we're seeing like more and more interesting high-level ideas coming out of the AI itself too and with really deeply”