Synapse Open Synapse
AI

Flash Next (Q2) on a 24GB M5 MacBook Air: 49 t/s decode with Splash expert streaming

Reddit · r/LocalLLaMA · · 2 min read

Qwen3.8-Flash-Next (ISTA GSQ-RCO Q2_0) + Flash-Next-DFlash2 draft on a MacBook Air M5 (24 GB), on Splash 1.4.0 with a small fork. Experts that don't fit are streamed from the SSD: 6,800 of 24,576 expert slots (~28%) live in ~8.8 GB, the rest is read on demand, 256K context.

Latest from Reddit · r/LocalLLaMA