Synapse Open Synapse
AI

[Paper & Models] MMFlash: Faster Speculative Decoding for Vision-Language Models

Reddit · r/LocalLLaMA · · 2 min read

Speculative decoding accelerates generation by letting a lightweight drafter propose tokens for parallel verification by a target model.

Latest from Reddit · r/LocalLLaMA