For live-inference workloads whose customers expect availability, interruption may require one to three months' notice, allowing capacity to be adapted over that period; a one-minute interruption notice is not acceptable.

“But if I have live inference customers who are expecting me to be online,”

“then.”

“You can interrupt me, but in a month, maybe two months, maybe three months.”

“Um and then I can adapt to that um capacity over that period of time. Um but you cannot interrupt me in a minute. Um and so those two things are priced differently and the reason why they're priced differently is because what is the price you would pay um in order to interrupt your batch job. It's very different than the price you would pay to interrupt your um live job.”