Solved High CPU usage when model fit in GPU, beware of -ngl -1 llama.cpp layers offloading to GPU and llama-fit-param
I'm trying to figure out how much context i can use on my 3090 (full compute, monitor is on mobo).
I'm trying to figure out how much context i can use on my 3090 (full compute, monitor is on mobo).