Richard Socher says reward engineers still need to work much more carefully because AI systems generally do not yet reliably distinguish intended meaning from literal wording.

“But what I think it shows is that we're currently in this sort of state of AI.”

“where the reward engineer still has to do a lot more careful work and where the AI in most cases is not very good yet at understanding what is meant versus what is being said.”