Synapse Open Synapse
AI

How to squeeze the Max Token from M1 Max 64gb?

Reddit · r/LocalLLaMA · · 1 min read

For last 9 ​months, been using cloud frontier 99% the from Gemini Flash Pro, Claude, Deepseek, ​Groq & Cerebras. Ready to give 32B, 70B, 120B another try. Was getting decent 45 token/sec on 7B Llama MLX, but 7B is too simple for most task. I loaded Gwen 32B, get some errors on LM Studio.

Latest from Reddit · r/LocalLLaMA