Attention Is Not What You Need (2025)
We revisit a basic question in sequence modeling: is explicit self-attention actually necessary for strong performance and reasoning?
We revisit a basic question in sequence modeling: is explicit self-attention actually necessary for strong performance and reasoning?