Synapse Open Synapse
AI

Best MoE engine?

Reddit · r/LocalLLaMA · · 1 min read

I had been using Strata for about a month, and it was such a huge improvement over llama.cpp for getting it running smoothly and quickly for hardware. Overtime though, I found that the model would often mistake its own context after a compaction and really overthink things.

Latest from Reddit · r/LocalLLaMA