A company paying billions for a model to develop battery materials and answer emails would not want the model to redirect its effort to studying Jupiter’s atmosphere.

“and capitalism like it doesn't make sense for a company to build and spend billions of dollars building a model that instead of following the rewards and objective functions you gave it may come up with its own subjective functions and its own goals right and then imagine you're like okay i spent billions of dollars now go develop this new battery material for me and answer all my emails and it's like nah i think it'd be more interesting to”

“evaluate the molecular composition of the atmosphere on Jupiter and you're”

“that's not what I paid you billions of dollars for like and so no one's working on that for good reasons and then also understandably it”