Synapse Open Synapse
AI

club-3090 / qengine / RedHatAI/Qwen3.8-27B-INT4

Reddit · r/LocalLLaMA · · 1 min read

This thing https://github.com/noonghunna/club-3090/blob/master/models/qwen3.8-27b/qengine/compose/dual/redhat-int4/mtp.yml https://github.com/bpx03/QEngine https://huggingface.co/RedHatAI/Qwen3.8-27B-INT4#accuracy i'm on 2x3090, and dual VLLM qwen3.8-27b fp8 was my daily.

Latest from Reddit · r/LocalLLaMA