DeepMind trained AlphaProof with reinforcement learning, beginning with middle-school-level problems and gradually progressing to International Math Olympiad-level problems before giving it the 2024 exam.

“They set it to work on the IMO. They train it to answer competition math-level problems, starting with basic middle school-level things. They do reinforcement learning, just like slowly re-reward climb until it is within range of IMO-level problems, and then they essentially administer the 2024 exam to AlphaProof.”