OpenAI encountered pre-training problems that made it difficult to scale the model.

“At OpenAI, we ran into problems with pre-training and therefore had difficulty scaling the model. In two thousand twenty-six, we've been able to solve many of these issues.”