---
title: "Ornith's DFlash Drafter Pushes Ornith-1.5-35B Decoding to 2.32× Faster"
subtitle: "Ornith pairs its 35B mixture-of-experts reasoning model with a block-diffusion draft that pushes decoding past 180 tokens per second on a single A6000."
url: "https://alphasignal.ai/news/ornith-s-dflash-drafter-pushes-ornith-1-5-35b-decoding-to-2-32-faster"
author: "AlphaSignal Newsroom"
author_url: "https://alphasignal.ai/editorial-team"
company: "AlphaSignal"
company_url: "https://alphasignal.ai/company/alphasignal"
published: "2026-09-20T02:26:28.000Z"
updated: "2026-10-02T13:57:21.074Z"
type: "Model"
topics:
  - "Infra"
  - "Reasoning"
subtopics:
  - "Inference Optimization"
  - "Test Time Compute"
upvotes: 18
source_url: "https://huggingface.co/ornith-ai/Ornith-1.5-35B-A3B-DFlash"
comments: 0
truncated: true
---

# Ornith's DFlash Drafter Pushes Ornith-1.5-35B Decoding to 2.32× Faster

> Ornith pairs its 35B mixture-of-experts reasoning model with a block-diffusion draft that pushes decoding past 180 tokens per second on a single A6000.

Ornith has released [a DFlash checkpoint](https://huggingface.co/ornith-ai/Ornith-1.5-35B-A3B-DFlash) that accelerates Ornith-1.5-35B-A3B by proposing blocks of tokens in parallel. The 35B target model scores those proposals and accepts valid tokens before generation continues. Fewer target-model passes can raise decode throughput at the low batch sizes common in coding agents and interactive reasoning workloads.

A separate single-GPU demo reported about 180 generated tokens per second on an RTX A6000 with 48 GB of memory. That configuration combined an AWQ-quantized target with the newer DFlash2 drafter, which adds path selection and a two-tap dynamic convolution. Its hardware, target precision, and drafter differ from the stock DFlash benchmark.

## The target keeps control

The DFlash checkpoint serves only as a companion to Ornith-1.5-35B-A3B, which performs verification and produces the final output. The target is a mixture-of-experts model with 35B total parameters and about 3B active parameters per token. Sparse activation reduces computation, although all 35B parameters must remain available in memory.

During decoding, DFlash proposes several token positions at once and the target scores the block in parallel. Exact acceptance and rejection logic preserves the target model’s probability distribution. Randomized runs can still produce different text because distributional equivalence does not guarantee byte-for-byte output under sampling.

## Diffusion fills the block

Conventional speculative drafters, including EAGLE-style heads, extend candidate sequences token by token. DFlash initializes an entire block and refines its positions through a short sequence of parallel denoising steps before verification. The approach aims to produce more useful candidate tokens per draft operation.

_Preview only. Full text requires an AlphaSignal Pro account._

## Sources

- [Ornith-1.5-35B-A3B-DFlash model card](https://huggingface.co/ornith-ai/Ornith-1.5-35B-A3B-DFlash)
- [Ornith-1.5 with DFlash in SGLang (benchmark repo)](https://github.com/ultimatechris/ornith-dflash-sglang)
- [DFlash: Block Diffusion for Flash Speculative Decoding](https://github.com/skyiron/dflash-speculative-decoding)
- [DFlash paper (arXiv 2602.06036)](https://arxiv.org/pdf/2602.06036)
- [jzinno/Ornith-1.5-35B-A3B-DFlash2](https://huggingface.co/jzinno/Ornith-1.5-35B-A3B-DFlash2)
