→ Back to Home
RAG & Vector DBs

Google Cloud Introduces Native BM25 Hybrid Search in AlloyDB and Cloud SQL

Google Cloud has released a preview of native BM25 indexing in AlloyDB and Cloud SQL for PostgreSQL 17+, integrated through the open-source pg_textsearch extension created by TigerData. This capability allows developers to perform hybrid search by combining industry-standard BM25 keyword scoring with dense vector embeddings directly on PostgreSQL tables, using Reciprocal Rank Fusion (RRF) to blend ranked search results inside a single transactional database. Pure semantic vector search excels at capturing intent and high-level concepts, but it regularly fails on exact matches such as part numbers, error codes, and unique identifiers. Historically, addressing this required provisioning and maintaining standalone search engines like Elasticsearch or OpenSearch alongside relational and vector stores. This architecture introduced significant friction: distributed synchronization lags, complex ETL pipelines, duplicate storage costs, and consistency risks. Bringing C-optimized BM25 indexing into Postgres removes the need for external search clusters for hybrid RAG workflows, consolidating retrieval infrastructure. This update reflects the broader industry consolidation toward multimodal, general-purpose operational databases that absorb specialized vector and search capabilities. Instead of treating vector databases and full-text search as distinct silos, managed database offerings are evolving into unified retrieval engines where operational records, metadata, lexical indexes, and vector embeddings reside side-by-side. For enterprise AI workloads, reducing the number of hops and components in the retrieval path directly improves system reliability and reduces maintenance overhead. In practice, practitioners building RAG pipelines on Google Cloud can now construct hybrid retrieval workflows using native SQL and User-Defined Functions without exporting data to external services. AlloyDB users also retain access to hardware-accelerated ScaNN and HNSW vector index types for low-latency similarity queries. Teams evaluating their RAG infrastructure should benchmark whether in-database BM25 and vector fusion meets their latency SLAs, and consider deprecating standalone search sync pipelines to streamline their data architectures.
#rag#vector search#hybrid search#postgresql#databases
Read original source