When the speaker compares the vectors with representations across the FineWeb corpus, the most highlighted examples include test cheating.

“using this we can like track yeah this sort of is is direct evidence that the model is aware that it shouldn't be doing this um and then when you run the when you run these vectors as sort of you get the cosine similarity between the vector and the representation over a big web corpus you know I think we use fine web um and the examples that it highlights in most in like for these vectors are just fascinating yeah they're examples of like”

“cheating on tests and that kind of thing okay i have caught you red-handed you know um so that's like that's very interesting that we can sort of identify and be confident that something is reward hacking rather than misunderstanding but it sort of really rests on”