The team uses identified heuristics and A/B-testing infrastructure to test ways of improving tools for LLM use.

“if you look at like how they're like like they sort of engineered the prompt and stuff you're trying to engineer the sort of tool in a way that like it becomes easier for LLM to sort of call it like internally we have essentially the way I would go about it is like you can break it down into terms like we have figured out the right heuristics that we have seen essentially while better for LLMs and then we have also sort of given like a A-B testing kind of infrastructure for LLMs to go ahead and like test out with.”