Synapse Open Synapse
AI

Swift-1.5 QFN iq2_xxs (strata, 64k ctx) vs Swift-1.5 27B q4_k_l (llama.cpp, 128k ctx)

Reddit · r/LocalLLaMA · · 1 min read

My daily driver: ukisai/Swift-1.5-Qwen3.8-27B-GGUF, Q4_K_L, 128k context, llama.cpp The model I want to switch to: ukisai/Swift-1.5-Qwen3.8-Flash-Next-GGUF, IQ2_XXS, 64k context, Strata I got pi to properly pass the thinking levels to QFN: "thinkingLevelMap": { "off": "none", "minimal": "low", "low": "low", "medium": "medium", "high": "high", "xhigh": "high", "max": "high" } So I set it to medium .

Latest from Reddit · r/LocalLLaMA