Synapse Open Synapse
AI

Monolithic ddr3 server

Reddit · r/LocalLLaMA · · 1 min read

Hi all. Do any of you guys run a server like this for inference of big models. Given deepseek is down to 8/16b active I'm curious as to whether this could start to make sense if I was to add a gpu. This server is local for $550 USD.

Latest from Reddit · r/LocalLLaMA