Proposed architectural approaches to managing context include sparse attention and KV-cache compaction, with new optimization papers appearing weekly.

“I talked before about how we already have many different working ideas for this kind of thing, from sparse attention to KV cache compaction.”

“And every week somebody releases a new paper suggesting some kind of other architectural optimization.”