definition claim
The evaluation uses an LLM-as-a-judge design, with a selected judge model, execution location, and judging prompt.
Zach Lloyd · ⚡️ The 2026 Software Factory Standard — Zach Lloyd, Warp.dev · 3 Nov 2026
In their words
The transcript segments this claim was taken from
“The eval is, again, think of it as LLM as a judge. So you're picking a, a judge model. You're, you're then seeing, okay, like where do these run? What's the prompt for judging it?”11:17Report a misattribution
0.95how strongly it was put, not whether it is true
0.70importance to the conversation
0.96confidence the claim was read correctly