descriptive claim
The team's Factorio experiments produced about one million scored agent-written programs and associated game traces and trajectories.
Jack Hopkins · ⚡️Factorio Learning Environment: the ultimate Game Agent Eval — Jack Hopkins · 27 Apr 2025
In their words
The transcript segments this claim was taken from
“it may not be directly applicable to the agent's immediate objective it didn't really give us any uptick in scores so i think we kind of put that in the bucket of what we're going to do when we when we start really throwing computer so for example we when we did all these experiments we kind of accumulated about a million programs that agents have written with scores attached so we kind of got this big bucket of programs and traces trajectories through the game and we want to take these and just kind of throw it at a model and just”22:12Report a misattribution
0.90how strongly it was put, not whether it is true
0.80importance to the conversation
0.94confidence the claim was read correctly