---
title: "JiRackUltra_14b Brings a 14B Model to Local CPU Without the Cloud"
subtitle: "A 14B ternary Qwen2.5-based model refactored with BitNet-style weights runs on plain CPUs with 8-12 GB of RAM and native tool-call plus robotics tokens."
url: "https://alphasignal.ai/news/jirackultra-14b-brings-a-14b-model-to-local-cpu-without-the-cloud"
author: "AlphaSignal Newsroom"
author_url: "https://alphasignal.ai/editorial-team"
company: "AlphaSignal"
company_url: "https://alphasignal.ai/company/alphasignal"
published: "2026-08-03T00:19:53.000Z"
updated: "2026-09-19T10:05:28.848Z"
type: "Model"
topics:
  - "Llms"
  - "Gpus"
subtopics:
  - "Small Models"
  - "Quantization"
  - "Edge Deployment"
upvotes: 3143
source_url: "https://huggingface.co/CMSManhattan/JiRackUltra_14b"
comments: 0
truncated: true
---

# JiRackUltra_14b Brings a 14B Model to Local CPU Without the Cloud

> A 14B ternary Qwen2.5-based model refactored with BitNet-style weights runs on plain CPUs with 8-12 GB of RAM and native tool-call plus robotics tokens.

# JiRackUltra\_14b Packages a 14B Model for Local CPU Inference

[JiRackUltra\_14b](https://huggingface.co/CMSManhattan/JiRackUltra%5F14b), a 14-billion-parameter model built around a Qwen2.5-style architecture, entered Hugging Face’s trending charts after its download counter reached roughly 991,000\. Hugging Face counts artifact downloads rather than unique users, so automated and repeated pulls can contribute to that figure.

The repository targets local inference with conventional tools: GGUF files for llama.cpp and Ollama, several compression levels, and a tokenizer extended with tags for routing, tool calls, media, and robotics. That combination could simplify private RAG systems and CPU-hosted agents, although the release lacks the benchmarks needed to establish its quality and speed.

## Inside the release

According to the model card, JiRackUltra\_14b uses 48 transformer layers, a hidden size of 5,120, 40 query heads, eight key-value heads, and a vocabulary of approximately 152,000 tokens. The weights are listed under the MIT license.

The eight key-value heads implement grouped-query attention, which lets several query heads share cached keys and values. This reduces KV-cache memory compared with standard multi-head attention, though cache use still rises with context length, batch size, and concurrent requests.

| Variant  | File size | Author’s RAM estimate | Intended trade-off                               |
| -------- | --------- | --------------------- | ------------------------------------------------ |
| BF16     | 28.1 GB   | 28 to 32 GB           | Highest-precision published checkpoint           |
| Q4\_K\_M | 10.1 GB   | 8 to 12 GB            | Recommended balance of size and quality          |
| Q3\_K\_M | 8.42 GB   | 7 to 10 GB            | Lower memory use with a larger quality trade-off |
| Q2\_K    | 6.81 GB   | 6 to 9 GB             | Maximum compression                              |

The published RAM ranges describe the model files more closely than a complete inference process. The operating system, runtime buffers, KV cache, prompt length, and concurrency all add memory pressure. A 10.1 GB Q4 file, for example, cannot remain fully resident on an 8 GB machine alongside the operating system; memory mapping may allow execution at the cost of paging and lower throughput.

## Run it with familiar runtimes

Recent Ollama builds can fetch the Q4 checkpoint directly from Hugging Face:

```
ollama run hf.co/CMSManhattan/JiRackUltra_14b:Q4_K_M
```

_Preview only. Full text requires an AlphaSignal Pro account._

## Sources

- [CMSManhattan/JiRackUltra_14b - Hugging Face](https://huggingface.co/CMSManhattan/JiRackUltra_14b)
- [microsoft/BitNet - GitHub](https://github.com/microsoft/BitNet)
- [1.58-bit large language model - Wikipedia](https://en.wikipedia.org/wiki/1.58-bit_large_language_model)
- [microsoft/bitnet-b1.58-2B-4T - Hugging Face](https://huggingface.co/microsoft/bitnet-b1.58-2B-4T)