Synapse Open Synapse
AI

Nanbeige4.3-33B Quantised GGUF

Reddit · r/LocalLLaMA · · 3 min read

Quant ladder of Nanbeige's new 33B model from 35.2GB down to 13.7GB For 32GB hardware the sweet spot is 20.3GB AD-IQ4_XS with a top-1% of 92.0% compared to BF16

Latest from Reddit · r/LocalLLaMA