Measured in game ticks required to execute policies and make progress, the performance gap between Factorio-playing models and human players is enormous.

“come up with quite complicated policies which a human player would have to kind of develop on the fly so in that sense the agent has an advantage but when we kind of track the number of ticks it took to execute these policies against the number of ticks a human player would spend to get somewhere the gulf between models playing this and humans playing it is absolutely enormous um”