Synapse Open Synapse
AI

Qwen3.8 27b hitting 6,645 tok/s on prefill and 316 tok/s decode peak on Saber

Reddit · r/LocalLLaMA · · 1 min read

I know what you are thinking "another inference engine?", yeah there has been a flood of them I feel now. I have been running this for over a month now and I have been on the fence to even release it, but I decided to as I took a different approach that others currently available.

Latest from Reddit · r/LocalLLaMA