---
title: "Unsloth Brings bge-small-en-v1.5 to GGUF, Beating OpenAI's Ada on CPU"
subtitle: "Unsloth packages BAAI's bge-small-en-v1.5 in GGUF format, making a 33M-param embedding model runnable anywhere llama.cpp runs — no GPU required."
url: "https://alphasignal.ai/news/unsloth-brings-bge-small-en-v1-5-to-gguf-beating-openai-s-ada-on-cpu"
author: "AlphaSignal Newsroom"
author_url: "https://alphasignal.ai/editorial-team"
company: "Unsloth AI"
company_url: "https://alphasignal.ai/company/unslothai"
published: "2026-06-09T11:00:55.000Z"
updated: "2026-06-19T20:12:25.123Z"
type: "Model"
topics:
  - "Retrieval"
  - "Benchmarks"
subtopics:
  - "Embeddings"
  - "Rag"
upvotes: 2465
source_url: "https://huggingface.co/unsloth/bge-small-en-v1.5-GGUF"
comments: 0
truncated: true
---

# Unsloth Brings bge-small-en-v1.5 to GGUF, Beating OpenAI's Ada on CPU

> Unsloth packages BAAI's bge-small-en-v1.5 in GGUF format, making a 33M-param embedding model runnable anywhere llama.cpp runs — no GPU required.

Embedding models are the quiet backbone of every RAG pipeline, semantic search system, and document retrieval stack. But most of them still ship as PyTorch weights that demand a Python environment and, ideally, a GPU. [Unsloth's GGUF release of bge-small-en-v1.5](https://huggingface.co/unsloth/bge-small-en-v1.5-GGUF) changes that equation: it repackages one of the most battle-tested English embedding models into the same portable binary format used for local LLM inference, making it trivially deployable on any machine that can run llama.cpp.

## The model behind the format

bge-small-en-v1.5 is a lightweight English sentence embedding model developed by the Beijing Academy of Artificial Intelligence (BAAI) as part of the BGE (BAAI General Embedding) series, designed for dense retrieval, semantic search, and similarity tasks. It produces 384-dimensional embeddings for comparing and ranking sentences or passages. With only 33.4M parameters, it provides a strong balance of accuracy and performance for English-only use cases. 

The v1.5 update was released to enhance retrieval ability without requiring query instructions and to fix an earlier similarity distribution issue. The BGE v1.5 models are still among the most popular embedding models that balance embedding quality and model size. On the MTEB benchmark , the standard evaluation suite for embedding models, covering 56 tasks across retrieval, classification, clustering, and more , bge-small-en-v1.5 scores 62.17 average across 56 tasks, with 51.68 on retrieval and 81.59 on STS (semantic textual similarity). That puts it ahead of OpenAI's text-embedding-ada-002 (60.99) despite being a fraction of the size.

_Preview only. Full text requires an AlphaSignal Pro account._

## Sources

- [unsloth/bge-small-en-v1.5-GGUF · Hugging Face](https://huggingface.co/unsloth/bge-small-en-v1.5-GGUF)
- [CompendiumLabs/bge-small-en-v1.5-gguf · Hugging Face](https://huggingface.co/CompendiumLabs/bge-small-en-v1.5-gguf)
- [BGE v1 & v1.5 — BGE documentation](https://bge-model.com/bge/bge_v1_v1.5.html)
- [Fine-tuning Embedding Models with Unsloth](https://unsloth.ai/docs/basics/embedding-finetuning)
- [GitHub - unslothai/unsloth](https://github.com/unslothai/unsloth)
