Synapse Open Synapse
AI

Strata for all Qwen models from little to big

Reddit · r/LocalLLaMA · · 1 min read

Ran every Qwen GGUF on my disk through RustingStrata and llama.cpp, same PC, same file, back to back. PC: RTX 3060 12 GB, Ryzen 5 7600X, 32 GB RAM. CUDA. Normal desktop open (browser, Discord), no tuning, so numbers are lower than in the README.

Latest from Reddit · r/LocalLLaMA