The Decisions API builds on Luna by constraining outputs, optimizing inference for low time to first decision, and batching multiple questions in parallel.

“like really just Luna and on top of that what you're doing is you're constraining so like structured output is a big part of it you're really optimizing the the inference stack to like get get very fast on TTFD and because you can have multiple questions what you do is like you basically run those in parallel like”

“As a batch.”

“all these yeah you run those in as a batch you all sorts of like inference techniques people are working on.”