Synapse Open Synapse
AI

Amazing free 3090 speedup hack, verified works 15% PP, 5% TG for free

Reddit · r/LocalLLaMA · · 4 min read

I saw this today on X and decided to try it, I havent seen it posted here yet. I ran it on a single 3090 benchmarked it with qwen 3.8 27B before and after the optimization and saw these results: Observed prompt-processing throughput improved 22–30% ; generation speed improved 1–5% .

Same story elsewhere

Latest from Reddit · r/LocalLLaMA