Synapse Open Synapse
AI

How fast can a rusty Macbook M1 Pro 16Gb 2021 actually code with Qwen / Nemotron models? I ran benchmarks for Qwen3.5 4B, 9B Q4s, 35B; Nemotron Dory 4B, Nano 9B/v2.

Reddit · r/LocalLLaMA ·

hey folks, im Ye, im one of the contributors to Kapitsa, an open source inference engine optimized specifically for Apple Silicon to run Qwen & Nemotron models that fit a regular MacBook. our custom-written Metal kernels let us tune for each chip and each model.

Latest from Reddit · r/LocalLLaMA