Synapse Open Synapse
AI

Live-Swap CUDA Workloads: llama.cpp, ComfyUI, Strata & More

Reddit · r/LocalLLaMA ·

Berth is a lightweight GPU resource manager written in Go. It controls which applications get access to your GPU, when they get it, and how that access is handed off. Instead of letting every application compete for VRAM, Berth manages access through leases, priorities, and a request queue.

Latest from Reddit · r/LocalLLaMA