arXiv · 2611.19085
DynaDFlash: Dynamic Feature Projection for Block Diffusion Speculators
Abstract
DFlash trains a parallel draft model on hidden features from its target model. Inspired by the previous work of DFlare that introduced per layer combinations of target hidden states, we test whether context dependent weighting of these states helps improve acceptance length of block diffusion speculators. We trained both a DFlash baseline for the Qwen 3 of block size 16, and a dynamic model that computes gates for each layer to affect the magnitude of hidden features before projection. While mean acceptance length between the dynamic model and the DFlash baseline didn't significantly differ, we notice that the dynamic model excels for drafting in the context of math. In an evaluation of 700 prompts from the MetaMathQA and Orca-Math datasets, the mean accepted length improves by 5%. We also found this lead to a 4.1% higher throughput for a subset of the same dataset in the context of speculative decoding.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Aadi Kulshrestha, Reese Chong. 2026-11-14. DynaDFlash: Dynamic Feature Projection for Block Diffusion Speculators. https://arxiv.science/abs/2611.19085
Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite arXiv Science by Indiciae: BibTeX · RIS.