4 sources healthy · latest episode 9 Nov 2026
normative claim

Continual learning should preserve the base model’s existing knowledge, making limited parameter changes valuable.

Dwarkesh Patel · The next big breakthrough will be AIs learning on the job · 26 Jun 2026

In their words

The transcript segments this claim was taken from

“And this is a very important property for continual learning because as you're learning on the job,”
“we don't want to overwrite and forget all the other things that the base model knows.”
14:42Report a misattribution
0.95how strongly it was put, not whether it is true
0.90importance to the conversation
0.99confidence the claim was read correctly
Continual learning should preserve the base model’s existing knowledge, making … · Savlar