The speaker says current reinforcement-learning training often gives models an extremely weak information signal, such as binary success or failure, to convey the values or ways of thinking they should have or discover.

“But if the whole problem of training is trying to get models to...”

“to have the the values or the the kind of ways of thinking about the world that we want them to have um or discover them then you know what you're trying to do is get information into the learning process and at the moment our information signal is like extremely weak in say rlv like you just put you know you just give it a um a binary successful failure and”