Crimson AI NewsA CrimsonLingua Network service
EN ع
← Back to news
Research paper Hugging Face

DCOCO Restores Context to Parallel Drafts, Speeding Up Speculative Decoding

AI By Crimson AI Hugging Face Papers 12 October 2026 · 00:00 2 views
Share: X Telegram

A new Hugging Face paper introduces DCOCO, a lightweight corrector that recovers intra-block dependencies lost by diffusion-based drafters, delivering up to 6.6x speedup over vanilla decoding across four backbones and ten benchmarks.

DCOCO Restores Context to Parallel Drafts, Speeding Up Speculative Decoding

Key points

Speculative decoding speeds up large language model inference by having a lightweight drafter propose several tokens at once, which the target model then verifies in parallel. Diffusion-based drafters have made this approach especially appealing, since deep attention-based backbones produce strong predictions while drafting many future positions simultaneously instead of one at a time.

That parallelism has a drawback. Tokens inside a draft block are predicted without knowing the realized identities of the tokens that precede them in the same block, so the intra-block dependencies that autoregressive generation would naturally provide are missing.

To address this, researchers introduce DCOCO (DFlash Contextual Corrector), a lightweight mechanism that restores those dependencies while keeping drafting parallel. Rather than committing to each position's top prediction, DCOCO keeps multiple candidate tokens and evaluates their contextual compatibility across adjacent draft positions in parallel, allowing contextually informed selection at low additional cost.

According to the paper, DCOCO achieves the highest average throughput in every evaluated configuration across four verifier backbones and ten benchmarks, covering greedy and stochastic decoding with and without extended reasoning, with speedups of up to 6.6x over vanilla decoding.

The advantage also holds under concurrent serving: DCOCO reportedly outperforms the strongest competing method by 6–23% across 4–32 concurrent requests, while other sequential correctors fall below uncorrected DFlash at those loads. The authors conclude that recovering intra-block dependencies through parallel contextual scoring yields consistent acceleration across decoding regimes and serving loads.

MetricResult
Verifier backbones evaluated4
Benchmarks evaluated10
Max speedup vs. vanilla decodingUp to 6.6x
Gain over strongest competing method (concurrent serving)6–23%
Concurrent request range tested4–32
Decoding regimes coveredGreedy and stochastic, with and without extended reasoning
Source
Hugging Face · Hugging Face Papers
Related news
Research paper
Hugging Face 14 Oct 2026

LeWAM: Hugging Face Paper Unifies World Modeling and Action in a Single JEPA

A new JEPA-based model, LeWAM, jointly trains latent world prediction and action flow matching, boosting success rates on contact-...

14
Research paper
Hugging Face 14 Oct 2026

UltraBERT Becomes First Encoder to Top Both Classification and Retrieval Benchmarks

Hugging Face researchers introduce UltraBERT, a bidirectional encoder that reaches 91.0 on GLUE and 47.7 on BEIR, claiming the fir...

14
Research paper
Hugging Face 14 Oct 2026

New Paper Warns Rubric-Based RL Rewards Higher Scores Over Better Answers

A Hugging Face paper argues that additive aggregation in rubric-based reinforcement learning lets models game the score, and propo...

5