Databricks' Unity AI Gateway Now Governs Every Agent Touching Your Data
Databricks' Unity AI Gateway hits GA with hard spend caps, smart routing, and unified governance across agents, MCPs, and coding tools — over a quadrillion tokens already processed.
- GA launch: Unity AI Gateway is now generally available, giving enterprises a unified control plane for AI cost, security, and model access.
- Scale: Over a quadrillion tokens have passed through the gateway in the past year; thousands of customers including Rivian, Asana, and Edmunds are already live.
- Core features: Hard spend caps, PII guardrails, prompt injection protection, MCP server governance, agent tracing, and multi-model routing via a single API.
- Smart Routing (Beta): Dynamically routes requests to the right model based on cost, quality, and budget — reserving expensive models only for tasks that need them.
- Competitive context: Puts direct pressure on standalone AI gateway vendors (LiteLLM, Portkey, Helicone) and platform rivals Snowflake and Palantir building similar solutions.
- What's next: Service policies and agent services remain in Beta; a governance webinar with CTO Matei Zaharia is scheduled for August 13.
Enterprise AI has a sprawl problem. Most large organizations are no longer running one or two models in production. They're managing fleets of coding agents, MCP servers, custom bots, and third-party AI apps, all pulling from sensitive data and racking up token bills with no central oversight. Databricks' Unity AI Gateway is now generally available, positioning itself as the single control plane to govern all of it.
The sprawl that forced this
AI deployments have become multi-model, multi-agent, and multi-vendor almost overnight. Developers run coding agents. Business users query enterprise data through AI interfaces. Internal teams launch custom agents to automate workflows. The result is what the industry calls "agent sprawl," and it creates three compounding problems:
- Runaway costs: Consumption-based token pricing means spend scales with usage, not headcount. Most AI tools have no native cost cap, and no single view of the full bill across vendors.
- Security and IP risk: Agents need access to sensitive data to be useful, which exposes PII, creates prompt injection vulnerabilities, and leaves confidential information sitting in agent traces that can be inadvertently stored or leaked.
- Vendor lock-in: Managing thousands of custom agents across disconnected platforms makes swapping models or adopting new tools nearly impossible without rebuilding governance from scratch.
What Unity AI Gateway actually does
Unity AI Gateway is a centralized runtime governance layer for AI agents, built as an extension of Unity Catalog. Traditional governance answers "who can access this asset." The Gateway answers a different question: what is an AI system permitted to do during a live interaction. That distinction matters because it shifts control from access-time to runtime, covering behavior, not just permissions.