Synapse Open Synapse
AI

OVH announces Olala mini 7A1B

Reddit · r/LocalLLaMA · · 3 min read

Olala mini is based on a 7-billion-parameter architecture (7B), with one billion active parameters spread across 256 experts per layer, and hybrid attention combining Differential-TPA and Mamba-3, in BF16 format.

Latest from Reddit · r/LocalLLaMA