BigMoeOnEdge outperforms Strata and colibri on 8-16 GB cards and Mac and you can run any model
Hi! for those who might not know the solution: it takes any MoE GGUF llama.cpp can load, whatever the quant.
Hi! for those who might not know the solution: it takes any MoE GGUF llama.cpp can load, whatever the quant.