Synapse Open Synapse
AI

[Paper] Continuum Attention

Reddit · r/LocalLLaMA ·

We introduce Continuum Attention (CA), a causal Transformer attention operator that replaces discrete key and value lookup with integration over a continuous, piecewise linear memory curve. Each query induces an exponential relevance density along the curve.

Latest from Reddit · r/LocalLLaMA