Synapse Open Synapse
AI

[Paper] Meta Expert: Cross-Layer Expert Sharing for Storage- and Retrieval-Efficient MoE

Reddit · r/LocalLLaMA ·

As model parameters scale up, sparsely activated Mixture-of-Experts (MoE) approaches have become essential for model scaling.

Latest from Reddit · r/LocalLLaMA