Synapse Open Synapse
AI

Joined the 4x R9700 Club | Initial Benchmarks for QFN 3.8 Below

Reddit · r/LocalLLaMA · · 6 min read

Posted this on the r/R9700 subreddit as well, but figured I'd share my initial findings here. tl;dr - One user writes at about 190 tok/s. Prefill runs at about 6,800 tok/s total no matter how many users there are.

Latest from Reddit · r/LocalLLaMA