Synapse Open Synapse
AI

Llama.cpp performance improvement over time (Gemma4 models)

Reddit · r/LocalLLaMA · · 1 min read

Few months ago - after Ninfer came out - I started a little hobby project to vibe-code my own engine for my hardware (RTX 5080 16GB Laptop) and check if it could beat llama.cpp - since at the time llama.cpp was kinda slow in comparison to something like vLLM, but vLLM is using VRAM very wastefully.

Latest from Reddit · r/LocalLLaMA