Skip to content
Card over a photo showing the vector search diagram, with the search API, cache, embedding service, vector and keyword indexes, and re-ranker.

Vector Search Architecture

Presentation template for Google Slides and PowerPoint

Make a copy in Google Slides
Price
Free
Slides
5
Difficulty
Intermediate
Updated
November 8, 2026

Every slide (5)

Overview

A shopper's query reaches the Search API with its active filters, which checks the result cache first. On a miss, the query embedding service turns the text into a vector using the same model as the indexer. The vector index and the keyword index search in parallel, and the vector index applies metadata filters during the search. Hybrid fusion merges both candidate lists, and the cross-encoder re-ranker scores the top 100. The API returns ranked results and caches popular ones.

Metadata filters run inside the vector index rather than after retrieval, so filtered results still fill the page. Cache keys include the filters and the index version, so no stale answer survives a reindex. Re-index the whole catalogue when the embedding model changes, because old and new vectors are not comparable. Recommendations can reuse the same vector index with item embeddings. To adapt it, point the indexing pipeline at your own catalogue events.

Useful for

  • Adding semantic search to an online shop with stock and price filters
  • Finding products by typed codes as well as descriptive phrases
  • Replacing keyword-only search on a media archive

What's included

  • A designed cover slide
  • The diagram: 10 components and 11 connections as editable shapes
  • A components table and the 6-step data flow
  • A legend with notes
  • The same diagram as a draw.io (diagrams.net) file

How to use it

  1. 1

    Click Make a copy in Google Slides, then confirm on the Google page. The copy is saved to your own Google Drive.

  2. 2

    Rename Shoppers and readers, Product catalogue, Search API and the other boxes inside Search platform to your own components, and delete the ones your system does not have.

  3. 3

    Rewrite the 6-step data flow and the 9-row components table so they match the arrows you keep.

  4. 4

    For the draw.io version, download vector-search-architecture-diagram.drawio and open it at app.diagrams.net.

What you need

Requirements

  • A Google account for Google Slides, or the free draw.io (diagrams.net) editor

Works with

  • Google Slides
  • Microsoft PowerPoint (File → Download → .pptx)
  • draw.io / diagrams.net (.drawio file)

Questions

What does hybrid search add over vector search alone?

Vector search finds items with similar meaning, but it can miss exact product codes and brand names. A keyword index catches those exact terms. Fusing both lists, here with reciprocal rank fusion, gives results that cover both kinds of match.

What does a cross-encoder re-ranker add to a search pipeline?

A cross-encoder reads the query and each candidate together, so it scores relevance more precisely than first-stage retrieval. It is slower per item, which is why it only scores the top 100 candidates. The first stage keeps the overall cost low.

Why must the query and the index use the same embedding model?

Each model maps text to its own vector space, so distances only mean something between vectors from the same model. A query embedded with a different model would match unrelated items. Changing the model means re-indexing the whole catalogue.

  • #ai-architecture-diagram
  • #architecture-diagram
  • #google-slides
  • #drawio
  • #diagram-template
  • #free-template

More ai architecture diagram templates

See all 12

Also in Developer workflows

All developer workflows templates
Get this template

Preparing your template…