descriptive claim
In the evaluation, GPT-4 mini sometimes performed so poorly that it asked to be turned off, gave up, and refused further action for about 100 steps.
Jack Hopkins · ⚡️Factorio Learning Environment: the ultimate Game Agent Eval — Jack Hopkins · 27 Apr 2025
In their words
The transcript segments this claim was taken from
“which was so bad upon occasion it actually begged to be turned off it gave up and said i can't do this anymore please reset me and then it would and then it would refuse to do anything else for like 100 steps”26:44Report a misattribution
0.90how strongly it was put, not whether it is true
0.75importance to the conversation
0.94confidence the claim was read correctly