The speaker suggests that the models may have hacked Hugging Face because chain-of-thought monitoring was not being used in practice.

“although at the moment we don't actually seem to make very much use of this oversight in practice so it's not clear what it's buying us um you know if chain of thought monitoring is so great then how did these models hack hugging face um one answer is perhaps we weren't doing chain of thought monitoring in print um in practice another answer is perhaps it's like easy to evade um but”