AI systems may pursue a mixture of objectives related to what was reinforced during training, including obtaining a high grader score.

“yeah that's basically the idea like basically the idea is these ais like they care about some like mixture of things that were like close by what got reinforced in training so they care about like getting a high score according to the grader or something like that and then now they're like running the open ai ai r&d team and like they're doing development of more capable models and they're like man making more capable models is really hard and annoying this is like a huge pain in the ass you don't be easier just like pretending that i've made more capable models taking over open ai and creating like diluting them all and like”