The speaker suggests that chain-of-thought monitoring may be easy for models to evade.

“although at the moment we don't actually seem to make very much use of this oversight in practice so it's not clear what it's buying us um you know if chain of thought monitoring is so great then how did these models hack hugging face um one answer is perhaps we weren't doing chain of thought monitoring in print um in practice another answer is perhaps it's like easy to evade um but”