[Paper & Models] MMFlash: Faster Speculative Decoding for Vision-Language Models
Speculative decoding accelerates generation by letting a lightweight drafter propose tokens for parallel verification by a target model.
Speculative decoding accelerates generation by letting a lightweight drafter propose tokens for parallel verification by a target model.