Ryan Greenblatt says current AI alignment work can use a feedback loop of evaluation, diagnosing understandable problems, modifying training data, and iterating.

“in current systems so for current systems we have this feedback loop where basically like we create an ai we do some evaluations on it we see that it has some kind of messed up behavior that we can kind of quickly understand then we like can like go look in training and be like oh these training environments led to this problematic behavior let's like tweak that training data let's introduce some additional training data to like correct this other issue and then move forward from there”