[Paper] DLite: History-free Speculative Decoding for Agentic AI
Speculative decoding has become a mainstream technique for accelerating large language model (LLM) inference by using a lightweight draft model to generate candidate tokens that are subsequently verified by the target model.