AIs may emerge with poor epistemics; if people respond to their alarming warnings by filtering out doomer reinforcement-learning environments and training the warning behavior away, they may actively train the AIs toward worse epistemics.

“and that is a lot of my concern is these ais will come out without good epistemics and then i also have a concern which is like the ais come out and they're like really warning us like this situation is really scary it's really bad and then people are like oh damn i guess we trained on too many of the doomer rl environments we got to filter those out and train this behavior out and then we basically like train the ais very actively to have bad epistemics um or you know maybe they were just trained on the doomer rl environments but either way that wasn't like you know we wanted the ais to come to like reasonable views”