Synapse Open Synapse
AI

JetBrains/Mellum2.1-12B-A2.5B-Thinking-MTP · Hugging Face

Reddit · r/LocalLLaMA · · 4 min read

Mellum2.1 Thinking with the MTP head Multi-token prediction head The multi-token prediction (MTP) head is one extra transformer block, trained together with the model, that predicts the token after the one just sampled.

Latest from Reddit · r/LocalLLaMA