A training environment can be generated from a complex process hidden as a latent variable, requiring the model to spend irreducible tokens and work to infer the process.

“there's environments where it's easier to go backwards and forwards and like what i mean by that is like it's very easy to define this like complex data generating process and this is like this kind of latent variable you keep hidden from the model um you can generate like arbitrarily complex like environments and the model has to do a lot of like irreducible like token spend and irreducible work to figure out what that data generation process was um there's asymmetries in terms of like you know you can inject information from the real world so like anthropic finds a bug you”