Synapse Open Synapse
AI

Prediction: more enthusiasts will get custom quantisations build by opus and Asta for their hardware and precision needs

Reddit · r/LocalLLaMA · · 1 min read

Based on my own little experiment and other reports I predict that more and more enthusiasts will ask a frontier LLM to build a custom quant of their favourite model. If Qwen 4 finally arrives I’ll try a ready made quant at first, probably unsloth.

Latest from Reddit · r/LocalLLaMA