Synapse Open Synapse
AI

I have an answer! Qwen Flash Next IQ2 IS better than Q8 of 27B (for me).

Reddit · r/LocalLLaMA · · 1 min read

I asked a while ago if it would be worth it to try and run qwen flash next at q2 since I can only really fit it and nothing bigger, but I can run Q8 of 27B. Everyone told me it’s either a toss up or Q8 would obliterate it. Not the case.

Latest from Reddit · r/LocalLLaMA