Synapse Open Synapse
AI

Don't underestimate cooling - run those fans 6-8 gt/s -> 17-20 gt/s no other changes

Reddit · r/LocalLLaMA · · 1 min read

I historically get about 6-8 t/s on my MI50 on Qwen @ Q6 running local coding. Building a script that sets my fans all on 100% duty cycle (and much louder) bumps that immediately to like 12 t/s. Letting the machine sit and cool for a while with the fans running, and running inference again...

Latest from Reddit · r/LocalLLaMA