Synapse Open Synapse
AI

I removed 85% of gemma's weights (and it is mostly fine)

Reddit · r/LocalLLaMA · · 2 min read

I pruned Gemma 4 26B-A4B, an MoE model, down to 15% of its original size, and the model still does great on one narrow task. It gets 92% agreement with the original on a classification task. That’s close to how often the 12B agrees with the 26B on the same ticks, which is 90%.

Latest from Reddit · r/LocalLLaMA