A benchmarks-and-gaps approach extrapolates selected benchmarks to estimate when they saturate and separately reasons about capabilities the benchmarks may not measure.

“so yeah the benchmarks is you take all the benchmarks that you like and you extrapolate them and you try to see when they saturate and then the gaps is thinking about all the stuff that you just mentioned and thinking about how”

“You know just because you've knocked down these benchmarks doesn't mean that you've already reached AGI There's all this other stuff that the benchmarks might not be measuring,”

“you know, you have to sort of try to reason about that”