Researchers are actively considering how to ensure alignment metrics capture the alignment humans care about, but there is no simple answer.

“have a serious problem and this this is something that researchers are thinking a lot about and um there's not a simple answer to this um there are tools that we have so we have monitorability and so we can get a sense of like is the agent scheming um”