Current oversight does not seem to be used much in practice, and its practical benefit is therefore unclear.

“although at the moment we don't actually seem to make very much use of this oversight in practice so it's not clear what it's buying us um you know if chain of thought monitoring is so great then how did these models hack hugging face um one answer is perhaps we weren't doing chain of thought monitoring in print um in practice another answer is perhaps it's like easy to evade um but”