The speaker's early conviction was that certification should require quarterly testing involving thousands of simulations to measure jailbreakability, jailbreak difficulty, hallucination frequency, and data deletion.

“conviction from early on that that was going to be the kind of crux was to pass this you must get tested every quarter basically run thousands of simulations to see also can it actually be jailbroken how hard is it to jailbreak how often does it hallucinate how often does it delete data etc”