Synapse Open Synapse
AI

models: Add Flint model (FlintForCausalLM) by alexey-rsi · Pull Request #30928 · ggml-org/llama.cpp

Reddit · r/LocalLLaMA · · 1 min read

now you can use Flint in llama.cpp (merged after 6h) Model specifications Property Flint Developer Recursive Architecture Decoder-only mixture-of-experts Transformer Total parameters 39.8B Active parameters per token Approximately 2.5B, including the output head¹ Layers 49: 2 dense layers followed…

Latest from Reddit · r/LocalLLaMA