Richard Socher says people have not learned to specify rewards clearly, while AI systems still struggle to infer intended meaning from reward instructions.

“is something we haven't gotten very good at as humanity and then clearly the ai in these cases has not gotten good enough at understanding what we mean when we ask it and give it certain rewards now what gives me hope is there are the first inklings uh of this being better i'll give you an example like whisper flow full disclosure i invested and i see it around but like at aix ventures but like whisper flow has gotten much much better at writing what you mean”