Synapse Open Synapse
AI

More 4x Intel B65 test results - Performance improvements - ~30% faster prefill and TTFT in flash-next vllm by increasing chunk size. & MPT benchmarks - and a video showing me actually using it in LibreChat.

Reddit · r/LocalLLaMA ·

edit: video clip is of me is using Flash-Next on Libre LLM with: Model: devan-carlin/Qwen3.8-Flash-Next-W4A16 , INT4 weights with 16-bit activations (W4A16). The BF16 n-gram embedding table is pinned in host RAM. Engine: vLLM 0.30.0 with the Lumnus b70.2 patches and full XPU graphs.

Latest from Reddit · r/LocalLLaMA