Synapse Open Synapse
AI

Has anyone done a in-depth comparison between Qwen-3.8 27b @ 8bpw and Qwen-3.8-FN @ 4bpw?

Reddit · r/LocalLLaMA · · 1 min read

Title says it all, I run dual 3090s (check out my post here for my setup ) at int8A16 and have been wondering if I'm missing out with QFN. There's posts ad-nauseam on reddit with low bpw strata solutions that run on heterogeneous systems, however those don't interest me - I want high precision.

Latest from Reddit · r/LocalLLaMA