How to squeeze the Max Token from M1 Max 64gb?
For last 9 months, been using cloud frontier 99% the from Gemini Flash Pro, Claude, Deepseek, Groq & Cerebras. Ready to give 32B, 70B, 120B another try. Was getting decent 45 token/sec on 7B Llama MLX, but 7B is too simple for most task. I loaded Gwen 32B, get some errors on LM Studio.