Real-time voice translation has been a demo-reel promise for years. You've seen the concept on stage, in sci-fi films, in product pitches. What's actually shipped has always lagged: clunky turn-based systems that wait for you to finish a sentence, then pause, then spit out robotic audio. Gemini 3.5 Live Translate is Google's attempt to close that gap for real, and it's available right now for developers to build on.

What actually changed

The Gemini Live API now supports low-latency, real-time speech-to-speech translation between 70+ languages using the gemini-3.5-live-translate-preview model. The key architectural shift is that the model handles real-time speech-to-speech translation as a continuous stream, not chunk-by-chunk. It stays just a few seconds behind the speaker throughout a session, rather than waiting for a full sentence to finish before translating.

The other big unlock is automatic language detection. It auto-detects language switches mid-sentence without any manual configuration. That matters a lot in practice: multilingual meetings, border crossings, customer support calls where the speaker might switch between languages mid-conversation no longer require you to pre-configure anything.

According to Google's model card, Gemini 3.5 Live Translate is based on Gemini 3 Pro, fine-tuned specifically for the translation pipeline. The model was evaluated across three dimensions: translation quality (using AutoMQM, an error-based metric that categorizes translation mistakes), latency, and speech naturalness.

The API surface is narrow by design

This is not a general-purpose multilingual assistant. The docs are explicit about it: text input is not supported in translation mode, and the model drops tool use and system instructions. For developers, the translation API call is a constrained surface -- you cannot send text, you cannot use the broader Gemini tool ecosystem, and you cannot inject system prompts.

Alpha Signal

Don't miss what's next in AI

Join 300,000+ engineers and researchers who get the signal, not the noise.

  • Full access to in-depth AI research breakdowns
  • Be the first to know what's trending before it hits mainstream
  • Daily curated papers, repos, and industry moves