Synapse Open Synapse
Tech

Huawei releases MACaQ, its internal quantizer for local inference

HN · · 2 min read

SOTA model-agnostic quantization for GGUF, local inference and beyond. Quantize and run text, image, video and audio models with llama.cpp, vLLM, Diffusers and PyTorch. - huawei-csl/MACaQ

Latest from HN