Synapse Open Synapse
AI

datapoint: 2x M5U cluster (GLM/Qwen)

Reddit · r/LocalLLaMA · · 1 min read

Caveats: IDK how to set anything up and I asked Deepseek to handle it - not enough training data so without specific guides the set up doesn't work well. I'm not a programmer. My previous model was Qwen 3.8 27B q4 using ninfer. Was getting around 1.4k prefill and 100-120 tokens decode.

Latest from Reddit · r/LocalLLaMA