→ Back to Home
AI Research

Google DeepMind Debuts Gemini 3.8 Live with Asynchronous Background Tool Calling

Google DeepMind has introduced two new multimodal speech-to-speech models: Gemini 3.8 Live, optimized for scale and low latency, and Gemini 3.8 Live Extended Thinking, built for high-complexity reasoning tasks. Rather than relying on traditional cascaded architectures—which chain automated speech recognition (ASR), large language model inference, and text-to-speech (TTS)—the new models operate natively across audio, text, and visual inputs. Crucially, the release incorporates asynchronous background tool calling, native visual grounding, dynamic language switching across 97 languages, and Gemini 3.5 Transcribe for dedicated speech-to-text workflows. This architecture directly addresses the primary bottleneck in conversational AI engineering: latency-induced dead air. Historically, when an AI agent initiated API calls, database lookups, or multi-step reasoning chains, dialogue halted until execution finished, prompting user confusion or premature interruptions. Gemini 3.8 Live Extended Thinking bridges this gap by acknowledging commands verbally (e.g., initiating verbal progress updates) while executing function calls concurrently in the background. For platform engineers and AI architects, this significantly shifts how real-time interactive voice response (IVR), automated dispatch, and live troubleshooting agents are built. The shift reflects a broader industry transition away from composite modular voice pipelines toward monolithic end-to-end multimodal systems. Standard voice agent stacks require complex orchestration layers to manage transcription streaming, token generation, audio rendering, and barge-in interruptions across separate infrastructure endpoints. By handling multi-step reasoning, visual processing, and tool invocation within a unified model context, DeepMind is collapsing the middleware layer required for agentic voice workflows, competing directly with frontier real-time offerings across cloud ecosystems. In practice, engineering teams evaluating Gemini 3.8 Live should reassess their conversational backend topology. Incorporating asynchronous background tools allows developers to wire enterprise APIs—such as inventory lookups, CRM modifications, and ticketing systems—directly into live streaming audio sessions via Google AI Studio and the Gemini Live API. However, teams must institute strict timeout policies, deterministic output parsing, and clear fallback loops, as managing stateful, concurrent reasoning during live streaming conversations increases edge-case execution risks.
#deepmind#gemini#voice-ai#multimodal#ai-agents
Read original source