If alignment metrics do not capture the alignment humans care about, that creates a serious problem.

“we have we have metrics and we can make sure that the ai is like very aligned according to the metrics that we have the question is like are those metrics really capturing the alignment that we care about and uh and if they're not then”

“have a serious problem and this this is something that researchers are thinking a lot about and um there's not a simple answer to this um there are tools that we have so we have monitorability and so we can get a sense of like is the agent scheming um”