EfficientZero’s apparent sample efficiency relative to humans depends on whether its dozens of internal simulated games per real-game step are counted.

“Does this mean that the model was more sample efficient than the humans?”

“Well, that was the goal of the training, but it depends on how you measure sample efficiency because for each step in the real game,”

“Efficient Zero is playing dozens of simulated games in its head. In a similar way, future LLMs might be able to...”