Synapse Open Synapse
AI

Update: tandem.cpp — DeepSeek-V4.1 on a 64 GB PC with a 16 GB card, and AMD (ROCm) support

Reddit · r/LocalLLaMA · · 2 min read

Quick update on tandem.cpp, my patch set for llama.cpp that runs MoE models too big for your VRAM faster. It keeps the hot experts on the GPU and lets the CPU help with the rest.

Latest from Reddit · r/LocalLLaMA