Synapse Open Synapse
AI

[Paper] Multi-Token Prediction Done Right - Soft-MTP

Reddit · r/LocalLLaMA · · 1 min read

Multi-Token Prediction (MTP) is now a common ingredient in language-model pre-training, as it improves downstream performance and enables faster inference through speculative decoding.

Latest from Reddit · r/LocalLLaMA