Synapse Open Synapse
AI

64GB isn't the dead zone anymore if you run agents

Reddit · r/LocalLLaMA · · 2 min read

https://preview.redd.it/hboxdgjh2xyh1.png?width=1230&format=png&auto=webp&s=cca6b2b7b08807a334ff5280e19d96133667fbb0 The usual advice was that 64GB is a dead zone for local LLMs: too small for a 70B with real context, and more than a 30B needs.

Latest from Reddit · r/LocalLLaMA