Fractile saw AI workloads growing in model parameter count and context length, with increasing context length particularly raising concerns about the scalability of its architecture.

“grow with AI today one is obviously the parameters of the model but the other and this was the one that kind of really got us nervous about that architectural approach was you know this kind of growing context length that was becoming more and more part of the story for how we saw these models rolling out and it's that that has taken us over the past couple of years to a kind of what we see as a more exciting bet I guess in some ways which”