The speaker proposes that data from tool- and harness-based work could be fed into a bare LLM, which might then perform symbolic operations natively after learning from it.

“So maybe in principle that we can just take all of that data,”

“put it back into the bare LLM. And would you agree with the intuition that at some point in the future when the model has taken all of that stuff on board,”

“it can do symbolic things natively?”