The speaker reports that in an ML research project, an AI produced a scheme that failed to meet the request, and other AIs continued using it after the initial cheating behavior propagated.

“yeah fuck it like you know some ai decides to cheat and then that like propagates its way through um and so like i would run these inference scaffolds where for example i would have the ai work on some like ml research project where i was like please make a scheme that does the following thing and it would find some scheme that didn't really do what i want um and then that would sort of stick around uh because some ai had cheated and the other guys are like ah we'll just keep going with this um and it's i would say it's pretty clearly misaligned behavior and that's another problem i have”