Synapse Open Synapse
AI

The minimum size of an LLM to generate a little meaningful convo

Reddit · r/LocalLLaMA · · 1 min read

I am trying to find the smallest model to generate something in "normal" English, it could be like AI generated, but it should be mostly grammar correct, sensible in the context. I hope it could be less than 10M to be easy for CPU, so I tested some like Supra-Mini-v6-1M. well it's not good enough.

Latest from Reddit · r/LocalLLaMA