Comparing models at a 2,000-token context where the architecture enables no new capability can make data appear more important than it is.

“so we couldn't get these capabilities even though like if you just do a naive like how much does this do at like 2k context where the architecture isn't unlocking anything then like the data you know that will look much more important than in some sense it is right it's unclear to me that these things are like really just like multiplicative gains in this way”