Skip to main content
Back

Apple drops a 3B on-device model to let you build AI-powered apps

TRY NOW

June 10, 2025 4 min read

Hey,

Welcome to AlphaSignal – the most read newsletter by AI developers. 


We bring you the top 1% of news, papers, models, and repos, all summarized to keep you updated on the latest in AI.

IN TODAY'S SIGNAL

Read time: 4 min 01 sec

🎖️ Top News

› Apple introduces Foundation Models framework to let you run a 3B model on your phone.

1,746 Likes

📌 Speechmatics

› Deploy real-time voice AI in 55+ languages with Speechmatics.

⚡️ Trending Signals

› Hugging face releases open-source MCP server to let you access its tools from VSCode and Claude desktop app.

3,028 Likes

› India's Sarvam AI launches a conversational AI platform to build AI agents in 11 Indian languages.

10,048 Likes

› Manus AI now supports Veo 3, allowing you to generate cinematic videos.

1,284 Likes

› OpenAI integrates tool use and structured output support to Evals, its model evaluation framework.

983 Likes

› Apple adds ChatGPT as a default assistant in Xcode, with support for integrating other models via API.

1,937 Likes

  💻 Trending Repos

› Use Apple’s framework to safely run Linux apps on macOS without a virtual machine.

☆ 2,349 Stars

› Manage dev tasks with Claude and Cursor using natural language.

☆ 13,610 Stars

› Create unlimited-length videos with this open-source diffusion video model.

☆ 2,948 Stars

🧠 Top Lecture

› Watch the video series for Apple's WWDC 2025 Platform Updates.


If you're enjoying AlphaSignal please forward this email to a colleague. 

It helps us keep this content free.

TOP NEWS

On-Device AI

Apple releases on-device LLM framework with structured output to build apps using local inference

1,746 Likes

The iPhone maker has launched the Foundation Models framework to let you run a 3B parameter model locally. The framework is part of Apple Intelligence suite and lets developers access it using just three lines of code.


You can use the model to generate text, extract summaries, and tag structured information from unstructured text.

Core Capabilities

  • You can define Swift types and control model output using @Generable and @Guide

  • The framework streams partially generated outputs instead of individual tokens, helping you update the interface in real-time

  • Tool calling lets the model trigger app-defined actions like data lookups during generation

  • The sessions retain multi-turn interaction history and follow developer-defined behavior

Access and Availability

  • Only available on Apple Intelligence-enabled devices with OS version 26+

  • Use Xcode Playgrounds to prototype with real model output

  • Use Instruments profiling template to measure latency and token overhead

  • No support for fine-tuning or external model deployment

Community Feedback

Adrien Grondin

"The Foundation Models Framework is super easy to use. Only a few lines of code are needed and has a modern Swift API. It uses Apple SOTA quantized model running on-device.Really good for many apps that want to start integrating on-device AI."

Joshua Riley
"I’m intrigued by how quick we can implement either RAG or tool calling for on device Q&A for docs/guides."

Simon Willison
"The WWDC announcements I'm most excited about are the new Foundation Models framework for accessing Apple's local LLMs and the Containerization framework for running Docker-style containers without hosting them all in a Linux VM."

Try now

Deploy Secure Voice AI Agents Anywhere: Real-Time, 55+ Languages, Compliant

With Speechmatics, deliver protected, accurate voice experiences, on-prem, on-device, or in the cloud. Keep every sensitive conversation secure in healthcare, finance, and beyond.

  • Fast, real-time speech recognition in 55+ languages

  • Resistant to noise and accent variations

  • Fully compliant with GDPR, HIPAA, SOC 2

  • Scalable deployments for enterprise needs

  • APIs designed for flexible integration and data security

  • Network with experts driving GenAI innovation

See Speechmatics enterprise features in action.

Request a demo

partner with us

TRENDING REPOS

Apple Framework

containerization

☆ 2,349 Stars

Run Linux containers natively on macOS 26 with Apple’s open-source Containerization framework. Build, pull, and execute OCI-compatible images with secure isolation. Optimized for Apple Silicon.

AI Tool

claude-task-master

☆ 13,610 Stars

Track and manage development tasks with Claude using natural language. Integrates with Cursor AI. Stores tasks in Supabase. Supports priorities, due dates, and follow-ups.

Video Generation

SkyReels-V2

☆ 2,948 Stars

An open-source video generation tool that generates cinematic videos. Supports script-to-video, lip-sync, music, LoRA effects, and storyboards. Runs locally and doesn’t enforce any length restrictions.

TOP LECTURE

AI Industry Update

Watch Apple’s video series about WWDC Platform Updates for developers

⇧ 11,493 Likes

This series breaks down Apple’s latest platform changes announced at WWDC 2025. It focuses on changes that affect how you design, develop, and deploy applications using Apple’s latest SDKs and AI integrations.


You will learn about the following and more:

  • How the new “Liquid Glass” design system affects UI structure and responsiveness

  • How to use Icon Composer for asset generation

  • How to integrate Apple’s Foundation Models framework

  • How Xcode has changed, including support for LLMs like ChatGPT

Watch now

At Alpha Signal, our mission is to build a sharp, engaged community focused on AI, machine learning, and cutting-edge language models, helping over 200,000 developers stay informed and ahead. We’re passionate about curating the best in AI, from top research and trending technical blogs to expert insights and tailored job opportunities. We keep you connected to the breakthroughs and discussions that matter, so you can stay in the loop without endless searching. We also work closely with partners who value the future of AI, including employers and advertisers who want to reach an audience as passionate about AI as we are.


Our partnerships are based on shared values of ethics, responsibility, and a commitment to building a better world through technology.Privacy is a priority at Alpha Signal. Our Privacy Policy clearly explains how we collect, store, and use your personal and non-personal information. By using our website, you accept these terms, which you can review on our website. This policy applies across all Alpha Signal pages, outlining your rights and how to contact us if you want to adjust the use of your information. We’re based in the United States. By using our site, you agree to be governed by U.S. laws.

Looking to promote your company, product, service, or event to 200,000+ AI developers? Let's work together.

Work with us