--- title: "Liquid AI's LFM2.5 Tops Mobile AI Charts Using Half the Memory" subtitle: "Liquid AI's LFM2.5 family posts Pareto-frontier scores on Artificial Analysis's new mobile benchmark, matching a top 3B model at 40% less memory." url: "https://alphasignal.ai/news/liquid-ai-s-lfm2-5-tops-mobile-ai-charts-using-half-the-memory" author: "AlphaSignal Newsroom" author_url: "https://alphasignal.ai/editorial-team" company: "Liquid AI" company_url: "https://alphasignal.ai/company/liquidai" published: "2026-09-21T17:14:52.000Z" updated: "2026-09-21T18:45:32.148Z" type: "News" topics: - "Llms" - "Benchmarks" subtopics: - "Small Models" upvotes: 253 read_time: "5 min" source_url: "https://artificialanalysis.ai/hardware-inference-stack/mobile-phones" comments: 0 --- # Liquid AI's LFM2.5 Tops Mobile AI Charts Using Half the Memory > Liquid AI's LFM2.5 family posts Pareto-frontier scores on Artificial Analysis's new mobile benchmark, matching a top 3B model at 40% less memory. Liquid AI’s LFM2.5-2.6B tied for the highest intelligence score on Artificial Analysis’s [mobile inference leaderboard](https://artificialanalysis.ai/hardware-inference-stack/mobile-phones) while consuming substantially less memory and time than its closest rival. Four of the five tested LFM2.5 entries also reached the joint Pareto frontier on both the iPhone 17 Pro and Galaxy S26 Ultra. A model reaches that frontier when no tested alternative improves one measured outcome without giving up ground elsewhere. For mobile developers, the result connects model quality to the memory and latency constraints that determine whether an agent can run locally. ## Phone limits become benchmark inputs Artificial Analysis developed the mobile evaluation suite in partnership with Liquid AI and says it independently validated the measurement process. Tests run through llama.cpp using model builds quantized to four bits or fewer, which compresses each weight to reduce memory and computation. The intelligence score averages five evaluations covering common mobile-agent capabilities: | Evaluation | Capability | | --- | --- | | BFCL subset | Function and tool calling | | IFBench | Instruction following | | AA-Omniscience | Factual knowledge | | GPQA Diamond | Graduate-level science questions | | MATH-500 | Mathematical problem solving | Latency measures the wall-clock time required to process a 1,024-token prompt and generate 256 tokens. The suite also records peak memory and how much work a model completes within one minute. Eligible models must fit within 8 GB after quantization, including the KV cache for an 8,000-token context. A KV cache stores attention state from earlier tokens and grows as the input becomes longer. Intelligence evaluations cap context at 16,000 tokens, so the benchmark does not test LFM2.5-2.6B across its advertised 128,000-token maximum. ## Equal score, smaller footprint Across 39 models, LFM2.5-2.6B tied Nanbeige 3B for the highest intelligence score, outperforming several models with three to 10 times as many parameters. Its resource advantage appears on both tested phones: | Device | Model | Peak memory | End-to-end latency | | --- | --- | --- | --- | | iPhone 17 Pro | LFM2.5-2.6B | 2.32 GB | 8.0 seconds | | iPhone 17 Pro | Nanbeige 3B | 4.03 GB | 21.4 seconds | | Galaxy S26 Ultra | LFM2.5-2.6B | 2.45 GB | 18.6 seconds | | Galaxy S26 Ultra | Nanbeige 3B | 4.13 GB | 71.4 seconds | Those figures give LFM2.5-2.6B roughly 40% lower peak memory and about three times lower latency across the cited comparison. Liquid AI says it is the highest-scoring tested model that stays below 2.5 GB on both devices. ## Hybrid layers cut CPU work LFM2.5-2.6B contains 2.69 billion parameters across 30 layers. Twenty-two layers use double-gated short convolution blocks, which process local token patterns efficiently, while eight use grouped-query attention, a design that shares attention state across query groups to reduce memory and computation. The mixture of convolution and attention limits how often the model performs attention’s more expensive global token comparisons. Fine-tuning lead Maxime Labonne says Liquid designed the architecture around CPU performance, which also allows the same weights to run on hardware such as a Raspberry Pi. ## A large training budget behind 2.69B parameters Pretraining consumed approximately 34 trillion tokens. Liquid doubled the vocabulary to 128,000 entries by extending the existing tokenizer, then added a dedicated mid-training phase to support contexts up to 128,000 tokens. Post-training combines supervised fine-tuning, domain-specific teacher models trained with verifiable rewards, on-policy distillation, and agent-focused reinforcement learning. Liquid used Group Relative Policy Optimization inside operational agent frameworks including Hermes Agent and OpenClaw, exposing the model to tool calls and multi-step tasks during training. ## Tools and structured data are the strongest fit Liquid recommends LFM2.5-2.6B for workloads that depend on instruction following, tool selection, extraction, retrieval-augmented generation, and long inputs. Suitable applications include: - Offline assistants that call local tools - Document triage over long inputs - Form and invoice extraction - Robotics command parsing - Background agents without per-token API charges Coding and knowledge-intensive work remain weaker areas. In Liquid’s reported results, LFM2.5-2.6B leads the included instruction-following tests and nearly every tool-use test, trailing Qwen3.5-9B on BFCLv4. Its LiveCodeBench v6 score is 59.41, compared with 69.86 for Qwen3.5-9B, giving larger coding-focused models an advantage for local programming assistants. ## Models span four deployment tiers The LFM2.5 variants highlighted by Liquid cover memory budgets ranging from small extraction systems to mixture-of-experts agents: | Model | Design | Intended use | | --- | --- | --- | | LFM2.5-230M | 230 million parameters, 32,768-token context, 65,536-token vocabulary | Fast tool use and high-volume extraction | | LFM2.5-1.2B | On-device reasoning model using less than 900 MB on a phone | Memory-constrained assistants and reasoning tasks | | LFM2.5-2.6B | 2.69 billion parameters with hybrid convolution and attention | Agents, tool use, extraction, and long-context workflows | | LFM2.5-8B-A1B | 8.3 billion total parameters with 1.5 billion active per token | Tool calling with mixture-of-experts routing | All four ship as open weights on Hugging Face. Published runtime support includes llama.cpp, MLX, vLLM, SGLang, and ONNX across Apple, AMD, and Qualcomm hardware. ## The license changes at $10 million The LFM Open License v1.0 is based on Apache 2.0 but adds a revenue threshold. Companies with less than $10 million in annual revenue may use the models commercially without charge. Commercial rights end when annual revenue reaches $10 million, at which point the company must negotiate a separate license with Liquid AI. ## Reproduce the result in your app Artificial Analysis provides a common baseline for comparing models under fixed hardware, runtime, quantization, prompt, and output conditions. Production performance will also depend on the application’s context length, tool schemas, concurrency, operating-system overhead, and sustained device temperature. Production teams can validate the benchmark result by measuring: - Peak memory at the application’s expected context length - Time to first token and total response latency - Accuracy with the exact quantized build selected for release - Tool-call reliability using production schemas and prompts - Battery use and thermal throttling during sustained workloads - License eligibility as company revenue changes For offline assistants, in-vehicle agents, and privacy-sensitive document workflows, LFM2.5 combines competitive benchmark quality with a footprint that fits current flagship phones. The mobile leaderboard supplies the starting point; workload-specific testing determines whether that advantage survives in production. ## Sources - [X post by @liquidai](https://x.com/liquidai/status/2102084158080045233) - [Consumer Inference Systems - Mobile Phones](https://artificialanalysis.ai/hardware-inference-stack/mobile-phones) - [Liquid AI Releases LFM2.5-2.6B: An On-Device Agentic Model](https://www.marktechpost.com/2026/08/06/liquid-ai-lfm2-5-2-6b-on-device-agentic-model/amp/) - [No cloud, no GPUs, no problem: Liquid AI's LFM2.5-2.6B](https://venturebeat.com/technology/no-cloud-no-gpus-no-problem-liquid-ais-new-model-lfm2-5-2-6b-brings-powerful-ai-agents-to-devices-as-small-as-a-raspberry-pi) - [LFM2.5-1.2B-Thinking: On-Device Reasoning Under 1GB](https://www.liquid.ai/blog/lfm2-5-1-2b-thinking-on-device-reasoning-under-1gb) - [Liquid AI Releases LFM2.5-230M](https://www.marktechpost.com/2026/06/27/liquid-ai-ships-lfm2-5-230m-with-llama-cpp-mlx-vllm-sglang-and-onnx-support-for-on-device-inference/)