Synapse Open Synapse
AI

24GB is plenty if your engines take turns

Reddit · r/LocalLLaMA ·

System service that watches your card, swaps and loads whatever you want, whenever you want. Don’t have to swap anything manually, collisions avoided, VRAM fully dedicated to each function while it’s running (no VRAM squatters).

Latest from Reddit · r/LocalLLaMA