4 sources healthy · latest episode 9 Nov 2026
opinion claim

The speaker says Factorio can distinguish model performance across a range from weak small models to superhuman models.

Jack Hopkins · ⚡️Factorio Learning Environment: the ultimate Game Agent Eval — Jack Hopkins · 27 Apr 2025

In their words

The transcript segments this claim was taken from

“you know, from tiny models that aren't very good all the way to superhuman models and enable us to differentiate them kind of at any step along the way.”
1:58Report a misattribution
0.90how strongly it was put, not whether it is true
0.80importance to the conversation
0.96confidence the claim was read correctly
The speaker says Factorio can distinguish model performance across a range from … · Savlar