Synapse Open Synapse
AI

Princeton and Polymathic AI release FlashMap: Flow Map Speculative Decoding

Reddit · r/LocalLLaMA · · 1 min read

Speculative decoding accelerates large language model (LLM) inference by using a lightweight drafter to propose a block of tokens that the target model verifies in one parallel pass.

Latest from Reddit · r/LocalLLaMA