Synapse Open Synapse
AI

[Paper] LatentLoop: Scaling Looped MoE Models with Asymmetric Compute Allocation

Reddit · r/LocalLLaMA ·

Looped Mixture-of-Experts (MoE) models combine parameter reuse with sparse computation to improve performance under matched budgets. Prior work demonstrates that different loop visits can play different roles even when they share parameters.

Latest from Reddit · r/LocalLLaMA