The cited virtual-machine performance difference concerns GPU kernel-launch latency, which is incurred frequently during model training or inference.

“It will affect, so in this particular case I'm talking about G_P_U_ kernel launches and how long it takes for that to happen, um which is a process that happens quite frequently when you're doing sort of either training or inference.”