The speaker is uncertain whether human-like transfer across problem-solving domains applies to models and asks whether Astra, without GPU-programming training data, could learn in context to optimize GPU kernels.

“I don't actually know this applies to models. For example, like in GPU code optimization,”

“one very interesting question is whether if you were to take out all of the GPU programming data like from a model.”

“but it was like as good as Astra is now just without like without taken out would it be able to still optimize GPU kernels like would it be able to learn in context roughly what it needs to learn and then like have some pipeline or like or come up with some solution to solving like optimization tasks and I think like there's like a mismatch between like if you took a human that was as smart or like knew as much Astra there is a mismatch between what that human can do and what Astra”