Synapse Open Synapse
AI

PSA Unsloth Q8 FN is massively better than the default strata Q3

Reddit · r/LocalLLaMA · · 1 min read

Just a PSA. I ran a realistic self host test on 3 models: Inb4 : “hurr derr no duh” The point is people on here act like these Q3 versions have minimal loss. Do tests for yourself it’s not even close. Qwen FN Q3 Qwen FN unsloth Q8 Orca nana-1 Maya GLM flash - Maya-S24 Prompt in comments.

Latest from Reddit · r/LocalLLaMA