descriptive claim
On the discussed benchmark, all models perform at 50% or below out of the box, including top frontier models, a result the speaker considers highly problematic for scientists.
Unresolved speaker · What Frontier Labs Buy: A Data Deep Dive with Handshake AI — Garrett Lord & Team · 9 Nov 2026
In their words
The transcript segments this claim was taken from
“Yes. So most, most models out of the box do fairly poorly. Um, all of them perform at 50% or worse, even the, uh, very top of the frontier models, um, which if you're a scientist is highly problematic.”33:25Report a misattribution
0.90how strongly it was put, not whether it is true
0.90importance to the conversation
0.96confidence the claim was read correctly