PSA Unsloth Q8 FN is massively better than the default strata Q3
Just a PSA. I ran a realistic self host test on 3 models: Inb4 : “hurr derr no duh” The point is people on here act like these Q3 versions have minimal loss. Do tests for yourself it’s not even close. Qwen FN Q3 Qwen FN unsloth Q8 Orca nana-1 Maya GLM flash - Maya-S24 Prompt in comments.