Synapse Open Synapse
AI

Today's Strata update boosts performance for R9700 users in Flash Next

Reddit · r/LocalLLaMA · · 1 min read

Today's update is welcome for us R9700 users (assume other gpu's as well). Prior to the update I was getting ~70 tok/s output with four R9700's and 256GB of system ram. Today's update brings it to 140-160 tok/s and ~3200 prefill running unsloth Q4_K_XL.

Latest from Reddit · r/LocalLLaMA