Synapse Open Synapse
AI

RustingStrata running Qwen3.6:35b-a3b with Q5 and MTP vs llama.cpp

Reddit · r/LocalLLaMA · · 1 min read

People asked how RustingStrata does with a bigger quant, so here's Q5_K_M on the same 3060 12 GB + Ryzen 5 7600X + 32GB DDR5 RAM. Model is unsloth's Qwen3.6-35B-A3B UD-Q5_K_M (the MTP version), 25 GiB, so about two thirds of the experts live on the CPU.

Latest from Reddit · r/LocalLLaMA