Synapse Open Synapse
AI

Multiverse Computing's Comet 60B (A12B) GGUFs with the MTP head

Reddit · r/LocalLLaMA · · 1 min read

I wanted to try MultiverseComputingCAI/Comet_60B_A12B_BF16 (Multiverse Computing's compressed version of Nemotron 3.5 Super), so I converted it to GGUF, and it runs on stock llama.cpp: Q4_K_M (42.6 GB) Q8_0 (64.2 GB) They keep the MTP head, so you can pass --spec-type draft-mtp to llama-server for speculative decoding.

Latest from Reddit · r/LocalLLaMA