Synapse Open Synapse
AI

When will we have another breakthrough for faster local dense models?

Reddit · r/LocalLLaMA · · 1 min read

Most of the speedup are touching along the likes like cutting the active params reletive to total params(MOE) but it does take a hit in stability & reliability compared to a dense-27b can be much more stable at low total params.

Latest from Reddit · r/LocalLLaMA