Synapse Open Synapse
AI

Not because you should, but because you can - Qwen-Flash-Next on a 16GB M2 Pro Mac Mini

Reddit · r/LocalLLaMA · · 1 min read

I was getting ready to sell an old kiosk Mini at our office that was getting an upgrade, and figured I would see what happened if I tried to make it do something it by all rights shouldn't be able to. I loaded up Strata and ran the iQ3_xxs quant of QFN with a max of 128k context.

Latest from Reddit · r/LocalLLaMA