Synapse Open Synapse
AI

Solved High CPU usage when model fit in GPU, beware of -ngl -1 llama.cpp layers offloading to GPU and llama-fit-param

Reddit · r/LocalLLaMA · · 2 min read

I'm trying to figure out how much context i can use on my 3090 (full compute, monitor is on mobo).

Latest from Reddit · r/LocalLLaMA