Legora uses a low-cost LLM-based online evaluation to estimate whether a user problem was solved and to assess new feature rollouts.

“And then we do some sort of-- we do online evals also, where it's like try to figure out generally, like, did we solve the problem here? Just where-- with like a super cheap LLM message, just try to just like have an online metric, and then we can use that also when we do roll-ups of new things.”