Synapse Open Synapse
AI

Strata speed up on Apple Silicon?

Reddit · r/LocalLLaMA · · 1 min read

Strata is the new hotness - claims of 4x tok/s increase over llama.cpp. I havent seen any posts talking about performance on Apple silicon however. Curious if anyone's run comparisons on Apple Silicon against llama.cpp and MLX

Latest from Reddit · r/LocalLLaMA