The speaker considers it plausible that people already use reinforcement-learning environments with injected subtle training-recipe bugs, training AI systems to identify the bugs and evaluating them with a rubric.

“like a moderate scale compute experiment where you like spin up the whole distributed infrastructure and then run it but oftentimes i think you'll be able to demonstrate it pretty convincingly um at smaller scale in a way which you could actually train on um and so my sense is that like it will not necessarily like i think it wouldn't be very surprising if right now people have rl environments where they like you know introduce a subtle bug into some training recipe train the ai to point out the subtle bug and then have like you know a rubric where they're like did it actually find the right bug”