Google Cloud Run Adds Blackwell GPU Support and Remote MCP Servers for Serverless AI
Google Cloud has expanded Cloud Run by adding support for NVIDIA RTX PRO 6000 Blackwell GPUs alongside a fully managed remote Model Context Protocol (MCP) server deployment mechanism. This update enables teams to deploy containerized large language models up to 70B+ parameters with automated scaling and scale-to-zero capabilities, while also giving developers native infrastructure primitives to build and govern AI agent tooling.
This release tackles the most punishing trade-off in modern AI engineering: the cost-latency balance of GPU capacity. Previously, serving large-parameter models required dedicated compute instances or complex Kubernetes GPU pool configurations that incurred massive bills when idle. Bringing Blackwell architecture GPUs to Cloud Run bridges the gap between high-throughput inference and serverless container simplicity. Furthermore, native remote MCP server support standardizes how enterprise agents interact with serverless tools, providing built-in authorization, isolation, and auditability without requiring bespoke microservice glue.
This milestone reflects the broader convergence of serverless runtimes and generative AI operations (GenAIOps). As the industry shifts from monolithic cloud deployments toward composable, agentic architectures, the traditional boundaries of Function-as-a-Service (FaaS) and container platforms have dissolved. Serverless is no longer confined to 15-minute, memory-constrained jobs; it is becoming the default control plane for variable-load artificial intelligence pipelines where unpredictable burst traffic must be met with elastic, hardware-accelerated compute.
In practice, engineering teams should assess their existing inference endpoints and agent toolsets for serverless migration. Workloads characterized by variable query volumes or daytime-only internal enterprise usage can immediately benefit from the scale-to-zero compute model, slashing idle GPU expenditure. However, practitioners must evaluate container cold starts on heavy GPU images and ensure container base layers are optimized via streaming or caching strategies to maintain strict SLA targets. Additionally, platform teams should adopt the managed MCP servers to enforce centralized IAM governance across all downstream autonomous agents.
Read original source