Google DeepMind trained AlphaProof with reinforcement learning, starting from basic middle-school mathematics and progressing toward International Math Olympiad-level problems.

“They set it to work on the IMO. They train it to answer competition math-level problems, starting with basic middle school-level things. They do reinforcement learning, just like slowly re-reward climb until it is within range of IMO-level problems, and then they essentially administer the 2024 exam to AlphaProof.”