Synapse Open Synapse
AI

BigMoeOnEdge outperforms Strata and colibri on 8-16 GB cards and Mac and you can run any model

Reddit · r/LocalLLaMA · · 1 min read

Hi! for those who might not know the solution: it takes any MoE GGUF llama.cpp can load, whatever the quant.

Latest from Reddit · r/LocalLLaMA