descriptive claim
Using the same model to fact-check its outputs can provide a small improvement, but it performs poorly because the model tends to approve claims indiscriminately.
Tom McGrath · Designing How AI Grows — Tom McGrath · 2 Sept 2026
In their words
The transcript segments this claim was taken from
“you know you'll get some things right we do this ablation in the paper like it'll it'll uplift a little bit um for reasons we can talk about in a second but it doesn't do very well because the model like basically just goes yeah that's cool everything's fine um you can use a more powerful model and now things are really starting to get slow and expensive and that that model still has its own its own knowledge gaps or you can use a more powerful model and web search”Play from 41:29Report a misattribution
90%how strongly it was put, not whether it is true
78%importance to the conversation
95%confidence the claim was read correctly