On the evaluated task, smaller models using the same automated-research harness can achieve the same public-set score as other models, and public-set performance is fairly consistent across models.

“And the second interesting thing is the public set performance are rather consistent across different models.”

“So if you have a like smaller models working on the same task with the auto research harness,”

“it can reach the same public score.”