Synapse Open Synapse
AI

Architecture trends: From full to local attention

Reddit · r/LocalLLaMA · · 1 min read

Currently working towards a bigger open LLM roundup. But in the meantime, just one of the interesting trends that stood out. I.e., looks like the transition from full to hybrid attention continues.

Latest from Reddit · r/LocalLLaMA