descriptive claim
The Factorio models have not been trained on the game; they have only limited knowledge of it and instructions for interacting with it, and must attempt the task without game-specific training.
Jack Hopkins · ⚡️Factorio Learning Environment: the ultimate Game Agent Eval — Jack Hopkins · 27 Apr 2025
In their words
The transcript segments this claim was taken from
“put them in the game and then compare it with the models because the models you know they have never been trained on this stuff they only know a little bit about factorio they they have the manual of how to interact with it and they just they just have to go and and try their best so maybe that's what we should do i should try and recruit my fiance and kind of make her sit down for for 10 hours in front of the game and see where we get”24:31Report a misattribution
0.90how strongly it was put, not whether it is true
0.80importance to the conversation
0.94confidence the claim was read correctly