---
title: "Qwen-2.5-1B-RLCD Scores JSON Fields in Parallel, Running 7x Faster on Apple Silicon"
subtitle: "A new open source inference engine on Apple Silicon evaluates every JSON field in parallel, cutting structured generation latency by 5.6x to 7x with guaranteed schema validity."
url: "https://alphasignal.ai/news/qwen-2-5-1b-rlcd-scores-json-fields-in-parallel-running-7x-faster-on-apple"
author: "AlphaSignal Newsroom"
author_url: "https://alphasignal.ai/editorial-team"
company: "AlphaSignal"
company_url: "https://alphasignal.ai/company/alphasignal"
published: "2026-09-23T01:07:54.417Z"
updated: "2026-09-23T01:10:26.127Z"
type: "Model"
topics:
  - "Llms"
  - "Gpus"
subtopics:
  - "Structured Output"
  - "Edge Deployment"
upvotes: 5831
source_url: "https://huggingface.co/harshatheg/Qwen-2.5-1B-RLCD"
comments: 0
truncated: true
---

# Qwen-2.5-1B-RLCD Scores JSON Fields in Parallel, Running 7x Faster on Apple Silicon

> A new open source inference engine on Apple Silicon evaluates every JSON field in parallel, cutting structured generation latency by 5.6x to 7x with guaranteed schema validity.

# Parallel field scoring speeds JSON extraction on Apple Silicon

An independent developer has released [Qwen-2.5-1B-RLCD](https://huggingface.co/harshatheg/Qwen-2.5-1B-RLCD), an Apache 2.0 inference engine for structured classification and extraction on Apple Silicon. The engine uses MLX to score multiple JSON fields in parallel against a shared key-value cache, avoiding the sequential token generation normally required to spell out an object. It requires no fine-tuning and relies on the model’s existing logits, which are its scores for possible next tokens.

The implementation targets schemas whose values come from fixed sets, such as booleans and categorical enums. The project name references “1B,” while the published configuration and benchmarks use `mlx-community/Qwen2.5-1.5B-Instruct-4bit`.

## Why JSON decoding drags

Conventional JSON mode and grammar-guided decoding remain autoregressive: each generated token depends on the previous tokens. Every step invokes the model again and reads from its attention cache, so latency rises with the length of field names, values, punctuation, and other serialized output.

A schema with 28 fields can therefore require hundreds of sequential decoding steps, even when every value belongs to a small set of known labels. Constrained decoding can block invalid tokens, but it still generates the object token by token.

Qwen-2.5-1B-RLCD treats each field as a classification problem. Given a predefined candidate set, the engine scores the permitted values and selects the highest-ranked option. Programmatic assembly then produces the JSON object without asking the model to generate braces, keys, commas, or quotes.

## One cache, many field branches

_Preview only. Full text requires an AlphaSignal Pro account._

## Sources

- [harshatheg/Qwen-2.5-1B-RLCD](https://huggingface.co/harshatheg/Qwen-2.5-1B-RLCD)
- [Parallel Constrained Decoding Demo](https://huggingface.co/spaces/drinkmoonshine/parallel-constrained-decoding)
- [Qwen2.5-1.5B-Instruct base model](https://huggingface.co/Qwen/Qwen2.5-1.5B-Instruct)