The team uses internal benchmarks built from queries that LLMs failed to translate into correct Salesforce calls, then works to improve tool behavior on those queries.

“And that optimization essentially is built on a bunch of sort of internal like benchmarks that we have, which is like which are around.”

“Here's like a query that we saw.”

“Here's a query that LLM couldn't really transform into the right set of Salesforce call.”

“That is the reason Salesforce API endpoint doesn't get into failure.”

“How do we sort of like make sure that we are able to get those kind of queries working nicely, right? And like we keep seeing the meta patterns.”