Synapse Open Synapse
AI

Qwen3.8 27b loop testing int4 awq vs int8

Reddit · r/LocalLLaMA · · 2 min read

I know this some old news, but i got some numbers here from my heavy agent load. In mid-October I switch from INT8 (4×3090) to AWQ INT4 (2×3090). Same sampling, harness(Hermes), and loop detector, so I compared about two weeks of logs from each setup. vLLM, FP8 KV, with DFlash2.

Latest from Reddit · r/LocalLLaMA