Pretraining the GPT series on large amounts of text developed reading and writing abilities and substantial crystallized intelligence, or acquired knowledge, over several years.

“much. Uh um we we saw with GPT um with the GPT series that by pre-training on a lot of uh text we got some sub-components of intelligence. We got reading writing ability and we got a lot of crystallized intelligence or acquired knowledge from that. Um uh and that process took several years. Um so it's it's not the case there's often people will sort of point out once it gets traction on it then it will solve it immediately.”