In Ryan Greenblatt's scenario, companies train AIs with real-world examples of poor performance and human or other feedback to improve task performance in those environments.

“And then we're also going to do things like find real world data where the AIs are not being that useful and train the AIs to like do a good job at the task in those real world environments based.”

“It's based on like human feedback or other sorts of feedback.”