Synapse Open Synapse
AI

[Paper] Joint Subspace Sparse Attention for Efficient Long-Context Decoding

Reddit · r/LocalLLaMA ·

Sparse attention reduces the KV-cache traffic that dominates long-context LLM decoding, but practical methods largely operate at coarse granularity.

Latest from Reddit · r/LocalLLaMA