Synapse Open Synapse
AI

Age of the bespoke engines?

Reddit · r/LocalLLaMA · · 1 min read

When I started, and for some time, llama.cpp was the answer. Now, it seems like llama.cpp is the new ollama. It's slow and out of date and just behind. There was Ninfee for those for whom that applied. Then strata came out... And that was an unimaginable upgrade. How is llama so far behind?

Latest from Reddit · r/LocalLLaMA