Synapse Open Synapse
AI

Inconsistencies in Unsloth's LiveCodeBench Results

Reddit · r/LocalLLaMA ·

I compared two published benchmark charts for DeepSeek-V4.1-Flash-1017 and noticed something rather unusual. All four Unsloth quantizations AND the Q8 baseline simultaneously improved by approximately 2–3 percentage points on LiveCodeBench v6.

Latest from Reddit · r/LocalLLaMA