Synapse Open Synapse
AI

[Paper] D3D: Decoupled Diffusion Drafting for Asynchronous Speculative Decoding

Reddit · r/LocalLLaMA ·

Target-conditioned diffusion drafters predict candidate tokens in parallel, yet each new block must wait for updated target-model hidden states. This forces drafting and verification to run sequentially, limiting speedup even though each block is generated in one pass.

Latest from Reddit · r/LocalLLaMA