A new science and engineering discipline is needed to understand model representations and learning in sufficient depth; without that understanding, AI practitioners will continue relying on improvised fixes.

“new science and a new engineering discipline like we don't understand in any we don't understand in the depth that's necessary like how models represent how they learn and that sort of thing and without that kind of understanding i think we're going to be jerry rigging stuff all the time um talking about concept ablation i think that's kaffed um and i think the idea here is that the model is not allowed to use this representation um”