---
title: "Unsloth's Qwen3.5-4B Doubles Token Speed Without Changing a Single Weight"
subtitle: "Unsloth published GGUF quants of Qwen3.5-4B with multi-token prediction baked in, delivering roughly 1.5x to 2x faster local generation through llama.cpp."
url: "https://alphasignal.ai/news/unsloth-s-qwen3-5-4b-doubles-token-speed-without-changing-a-single-weight"
author: "AlphaSignal Newsroom"
author_url: "https://alphasignal.ai/editorial-team"
company: "Unsloth AI"
company_url: "https://alphasignal.ai/company/unslothai"
published: "2026-05-13T12:44:22.000Z"
updated: "2026-08-22T02:01:06.139Z"
type: "Model"
topics:
  - "Llms"
  - "Gpus"
subtopics:
  - "Small Models"
  - "Quantization"
upvotes: 2479
source_url: "https://huggingface.co/unsloth/Qwen3.5-4B-MTP-GGUF"
comments: 0
truncated: true
---

# Unsloth's Qwen3.5-4B Doubles Token Speed Without Changing a Single Weight

> Unsloth published GGUF quants of Qwen3.5-4B with multi-token prediction baked in, delivering roughly 1.5x to 2x faster local generation through llama.cpp.

Unsloth has shipped [Qwen3.5-4B-MTP-GGUF](https://huggingface.co/unsloth/Qwen3.5-4B-MTP-GGUF), a set of quantized builds of Alibaba's 4B vision-language model that ship with a multi-token prediction head wired up for speculative decoding. The practical payoff: llama.cpp can now generate output for this model noticeably faster on the same hardware, without changing the weights the main model uses for its final answers.

## Where the speedup comes from

Multi-token prediction (MTP) is a small auxiliary head trained alongside the main transformer to guess the next few tokens in one shot. The head proposes several future tokens, then the main model verifies them in parallel, cutting the number of forward passes needed during generation. Accepted guesses yield multiple tokens per decode step for the price of one; wrong guesses fall back to standard decoding. Qwen built the MTP path directly into Qwen3.5, so this is a first-class feature of the model rather than a bolt-on draft.

Unsloth's release note quantifies the gain at roughly 1.5x to 2x faster generation, and the underlying llama.cpp support has now been merged into the main branch. That lines up with what the same team has reported for related Qwen models, where MTP speculative decoding delivers 1.4-2.2x throughput with no change in accuracy, which matters most for local models where every token per second counts.

_Preview only. Full text requires an AlphaSignal Pro account._

## Sources

- [unsloth/Qwen3.5-4B-MTP-GGUF on Hugging Face](https://huggingface.co/unsloth/Qwen3.5-4B-MTP-GGUF)
- [How to Run MTP Models: Multi-Token Prediction Guide](https://unsloth.ai/docs/models/mtp)
- [Qwen3.6 - How to Run Locally](https://unsloth.ai/docs/models/qwen3.6)
- [Multi-Token Prediction (MTP)](https://sebastianraschka.com/llm-architecture-gallery/mtp/)
- [Qwen/Qwen3.5-2B model card](https://huggingface.co/Qwen/Qwen3.5-2B)