bCloud AI

Vector Database Hybrid Search

Here’s the failure that sends teams looking for hybrid search in the first place. You build semantic search on a vector database, it handles “warm jacket for rainy commutes” beautifully, and then a customer types DW745-B and gets three products that aren’t the one they asked for. Vectors understand meaning. They’re mediocre at exact strings.

Hybrid vector search fixes that by running keyword matching and vector similarity together and fusing the results. The question for anyone choosing infrastructure is which vector databases support it natively, and which leave you to build the fusion layer yourself. This guide answers that across seven platforms.

What hybrid vector search actually does

Hybrid vector search combining keyword BM25 scoring and vector similarity in a single query

Hybrid vector search runs two retrievers against the same query. The lexical side scores exact term matches, almost always using BM25 — the ranking function documented in Wikipedia’s Okapi BM25 entry — which excels at identifiers, part numbers, and rare terms. The semantic side embeds the query and finds nearby vectors using an approximate nearest-neighbor index, typically HNSW from the 2016 paper.

Then the two ranked lists have to become one. That’s the fusion step, and it’s where implementations genuinely differ.

Reciprocal Rank Fusion (RRF)

merges by position rather than score. Each result gets points based on where it ranked in each list, and those are summed. RRF’s advantage is that it sidesteps an awkward problem: BM25 scores and cosine similarity live on completely different scales, so comparing them numerically is meaningless. RRF needs no tuning and works well out of the box, which is why it’s the common default.

Weighted score fusion

normalizes both score types onto a shared scale and blends them with a weight — 60/40 favoring semantics, for example. More control, more maintenance, and the normalization is fiddly enough that most teams should start with RRF and move only when relevance data justifies it.

If the concept is new, our what is hybrid search guide covers the mechanics in plain English, and the vector database hub explains the storage layer underneath.

The 7 platforms, ranked by hybrid capability

1. Weaviate — the native hybrid leader

Weaviate fuses BM25 keyword scoring, dense vectors, and metadata filtering in a single query, with an adjustable alpha parameter controlling the semantic-lexical balance. It also bundles vectorization modules, so you can insert raw text and get embeddings automatically rather than running your own pipeline. On its Shared Cloud tier, BM25 is included with no separate billing.

Pricing is dimension-based — roughly $0.095 per million dimensions stored per month on Shared — which means higher-dimension embeddings cost proportionally more. A 10M-vector index lands around $135/month, though binary quantization drops that toward $30. Query latency runs 30–70ms, with hybrid adding roughly 10–20ms.

Verdict: if hybrid vector search is your primary requirement, this is the default choice.

2. Qdrant — best filtered hybrid performance

Qdrant supports hybrid retrieval through its Query API with server-side fusion, and its real distinction is filtered search performance. Rust-based with rich payload filtering, it maintains low latency when constraints are applied — where several competitors see 2–3× slowdowns. Since virtually every production query carries filters, this matters more than headline benchmarks suggest.

Cloud pricing starts around $0.014/hour per node, landing near $65/month at 10M vectors. Latency runs 15–30ms in-memory. Verdict: best when hybrid vector search must survive heavy metadata filtering.

3. Milvus — hybrid vector search at billion scale

Milvus supports multi-vector search with fusion, and is engineered for the largest deployments — highest write throughput of the major options thanks to its distributed architecture, with disk-based indexing that saves substantial RAM cost at scale. Operationally heavier than the alternatives. Verdict: the choice past a billion vectors.

4. Elasticsearch / OpenSearch — mature hybrid, heavy operations

These arrive at hybrid vector search from the opposite direction: decades-old BM25 implementations with dense-vector kNN and RRF added. If you already run Elasticsearch, hybrid capability may already be in your stack. The cost is cluster operations you own permanently. Verdict: strong if you’re already invested.

5. Pinecone — hybrid via sparse-dense vectors

Pinecone supports hybrid through sparse-dense vector pairs rather than a built-in BM25 engine, which means you generate sparse representations yourself. Fully managed with no self-hosting option, serverless pricing at $0.33/GB/month storage, $8.25 per million read units, and $2.00 per million write units. Serverless recall is fixed near 90% with no tuning available. Verdict: workable, but hybrid is less native than Weaviate’s.

6. pgvector — hybrid you assemble

Postgres already has full-text search. Add pgvector and you have both halves — but you write the fusion query yourself, typically combining ts_rank and vector distance in SQL. No extra infrastructure and no license cost beyond the database you already run, around $45/month on RDS at 10M vectors. Verdict: genuinely good below a few million vectors if you’re comfortable writing the SQL.

7. Vespa — search-first hybrid vector search

Vespa was a search and ranking engine before vectors were fashionable, so hybrid vector search is native rather than bolted on, with sophisticated ranking expressions. Steeper learning curve. Verdict: powerful for teams who’ll use the ranking depth.


AI Search Grader by bCloud AI

Grade your ecommerce search in 10 quick questions

31% of ecommerce searches return zero results — and most shoppers who hit a dead end leave for a competitor. How does your store's search stack up?

Answer 10 short questions and get your AI search score, plus a personalized report to fix the gaps. Free, takes about 2 minutes.

No signup needed to take the quiz.

Relevance Question 1 of 10

Understanding intent…

Scoring your answers across relevance, AI, experience, and insights.

✓ Quiz complete

Your AI search score is ready

Tell us where to send your personalized report. You'll see your score and recommendations right away.

Please enter your first name.
Please enter a valid email address.

We'll email your report and occasional search-optimization tips. Unsubscribe anytime. Your data stays yours.

0 out of 100
Grade —

Your score by pillar

Personalized recommendations

Fix the gaps in weeks, not quarters

bCloud AI replaces keyword-only search with hybrid AI retrieval — sub-200ms responses, 99.99% uptime, and conversion lifts of up to 40% across 50+ implementations.

How to evaluate hybrid vector search

Five hybrid vector search tests, run on your own data. Vendor benchmarks won’t tell you what you need.

Test the hybrid vector search exact-match floor.

Query real SKUs, part numbers, and model codes. They must resolve literally, every time. This is the entire reason you’re adding hybrid.

Test with filters applied.

Take your most restrictive real facet combinations and measure p95 and p99. Filtered performance is where platforms diverge most, and unfiltered numbers flatter everyone equally.

Ask which fusion method they use.

RRF or weighted scoring, and how you’d change the balance. Confident vendors answer in a sentence; vague answers usually mean less hybrid capability than the marketing implies.

Check whether tuning is possible.

Can you shift the semantic-lexical balance per query type? Technical catalogs usually want more lexical weight; descriptive categories want more semantic.

Measure recall against ground truth.

Approximate search degrades silently — no error, just slightly worse results. Build a brute-force ground-truth set on a sample of real queries and check periodically. Our nearest neighbor search guide covers why, and search relevance metrics covers the scoring.

What hybrid costs you

Being straight about hybrid vector search trade-offs matters, because “run both” isn’t free.

Latency.

Two retrievers plus fusion is more work per query — typically 10–20ms extra on Weaviate. Well-engineered systems still land under 200ms, but benchmark under real load rather than trusting an idle index.

Hybrid vector search means two indexes to maintain.

A lexical index and a vector index, both needing updates when content changes. Our real-time indexing guide covers keeping both current.

More configuration surface.

Embedding model, fusion method, weights, candidate depth, index parameters. More knobs means more ways to misconfigure.

Reindexing on model changes.

Swap embedding models and you re-embed everything. The lexical side is unaffected, which is a small mercy — the vector embeddings storage guide covers planning for this.

Tuning the balance between keyword and vector

Once hybrid vector search is running, most remaining gains come from the semantic-lexical balance — and this is where teams either compound their advantage or quietly regress.

Start with RRF and leave it alone.

Reciprocal Rank Fusion needs no tuning and performs well across query types. Resist adjusting anything until you have relevance data proving a specific change helps.

When you do move to weighted fusion, tune per catalog, not per intuition.

Technical catalogs dense with part numbers usually want more lexical weight. Fashion, home, and gifting catalogs — where shoppers describe rather than name — want more semantic. The right split for your data is an empirical question, and hand-picking a few queries that “look better” is how relevance quietly degrades.

Consider per-query-type balancing.

Sophisticated implementations detect query shape and shift the balance dynamically: a short alphanumeric string leans lexical, a full sentence leans semantic. This delivers more than a single global weight, and a few platforms support it natively.

Watch candidate depth.

How many results each retriever returns before fusion — commonly 50, 100, or 200. Too shallow and good matches never reach fusion; too deep and you add latency while feeding noise to any downstream reranker.

Score every change against a judged set.

Build 200–500 real queries from your logs with relevance judgments, and score offline before shipping. Then confirm with a live split. Without that, every tuning decision is an opinion wearing a number.

Hybrid vector search in RAG pipelines

Ecommerce isn’t the only place this matters. Retrieval-augmented generation depends entirely on fetching the right passages, and hybrid vector search has become the default there for the same reason it won in commerce: a user asking about error code 0x8007 needs exact matching, while a user asking “why does my sync keep failing” needs meaning. Both arrive at the same endpoint.

The failure mode in RAG is unusually costly, too. Retrieve the wrong passage and the model generates a confident wrong answer with no signal that retrieval was the problem. That makes the coverage hybrid provides more valuable than raw speed — a different calculus from ecommerce, where latency is directly a conversion lever.

If you’re adopting hybrid vector search specifically for product search, there’s a decision worth making before comparing vector databases at all.

A vector database with hybrid support gives you the retrieval layer. Product search also needs an embedding pipeline that keeps pace with catalog changes, business-signal reranking that weighs stock and margin, merchandising controls a non-engineer can use, and analytics to prove any of it works. Assembling that is a multi-month project you then own.

A managed search platform includes all of it with hybrid retrieval configured. bCloud AI works this way — BM25 and vector fused, real-time indexing, reranking, and merchandising as one service, live in about four weeks. Our roundup of the top semantic search solutions for e-commerce compares that category, and the vector database comparison covers the build route.

Neither is wrong. Building is right when discovery is your product. What’s wrong is starting a build without knowing it’s one.

Common mistakes with hybrid vector search

  • Assuming “hybrid” means the same thing everywhere. Some platforms fuse BM25 and vectors in one query; others expect you to supply sparse vectors or write the fusion yourself. Ask specifically what the vendor means.
  • Tuning weights without a judged set. Adjusting hybrid vector search balance because a handful of hand-picked queries look better is how relevance quietly regresses over months.
  • Benchmarking without filters. Unfiltered numbers flatter every platform and predict nothing about production, where nearly every query carries constraints.
  • Ignoring the second index. Hybrid vector search means maintaining lexical and vector indexes in sync. A freshness gap between them produces inconsistent results that are painful to debug.
  • Skipping recall measurement. Approximate retrieval degrades silently. Without brute-force ground truth on real queries, you’ll never see it happen.

Frequently asked questions

Q1

What is hybrid vector search?

Hybrid vector search runs keyword matching and vector similarity retrieval in parallel against the same query, then fuses the two ranked lists into one. It combines the exact-match precision of BM25 with the meaning-awareness of embeddings, so both SKUs and descriptive natural-language queries resolve correctly.

Q2

Which vector databases support hybrid search natively?

Weaviate leads with single-query BM25 plus vector fusion and an adjustable alpha parameter. Qdrant supports it with strong filtered performance, Milvus at billion scale, and Elasticsearch and OpenSearch via mature BM25 plus kNN with RRF. Pinecone uses sparse-dense vector pairs, and pgvector requires you to compose the fusion query in SQL.

Q3

What is Reciprocal Rank Fusion?

RRF merges two ranked lists by each result’s position rather than its raw score, avoiding the problem that BM25 scores and cosine similarity use incompatible scales. It requires no tuning, which makes it the common default in hybrid implementations.

Q4

Does hybrid search slow down queries?

It adds work — typically 10–20ms on top of vector-only retrieval — because two retrievers run plus a fusion step. Well-built systems still return results under 200ms. Benchmark at p95 and p99 with your real filters under concurrent indexing load.

Q5

Do I need hybrid search, or is vector search enough?

If your content contains exact identifiers — SKUs, part numbers, model codes, ISBNs — you need hybrid, because pure vector retrieval approximates on those. If your content is purely descriptive prose with no identifiers, vector-only may suffice.

Q6

Can I add hybrid search to pgvector?

Yes. Postgres includes full-text search, so you can combine ts_rank with pgvector distance in a single SQL query and implement your own fusion. It works well below a few million vectors and requires you to write and maintain that query yourself.

Hybrid retrieval without the build.

bCloud AI fuses BM25 and vector search in one sub-200ms engine, with reranking and merchandising included.

bcloud.ai

Leave a Comment

Your email address will not be published. Required fields are marked *

Scroll to Top