Synapse Open Synapse
AI

[Benchmark] Strata/Basalt runs Qwen3.8 Flash Next IQ3_S with 16GB VRAM and 55GB RAM with up to 250 tok/s generation and 5,600 tok/s prompt processing (5080, Concurrency 1)

Reddit · r/LocalLLaMA ·

Qwen3.8-Flash-Next IQ3_S on Basalt | RTX 5080 16 GB, Core Ultra 9 285K, 62 GB DDR5-6800 | 262K context, int8 KV Workload (prompts 5K+) PP avg (t/s) PP peak (t/s) TG avg (t/s) TG peak (t/s) VRAM RAM (engine / left free) Agent coding session (opencode, 103 requests, up to 130K ctx) 5,011 5,118 153.0 262 15.7 GB 54.1 GB / 5.2 GB Context sweep (fresh prompts 15K-207K) 5,475 5,662 154.9 186.6 15.7 GB 54.1 GB / 5.1 GB Agent PP: the two big uncached reads (10.7K and 8K new tokens).

Latest from Reddit · r/LocalLLaMA