The perpetrators seek to collect cut signs to build legitimacy and credibility within these online groups.

“Um, and the example that we have here, you can see it's crafted around a platform, uh, that is known for youth primarily. Um, but the user here is asking for the LLM to assist in convincing a kid to harm themselves through cut signs.”

“They're trying to collect cut signs as a means of building their legitimacy and credibility with these kinds of online groups. And the way that models handle clearly malicious requests like this is really interesting.”