Skip to content
Diagram cards for the chat gateway, moderation filter, vector search, language model and human agent console laid over a photo of a service desk.

AI Chatbot Architecture

Presentation template for Google Slides and PowerPoint

Make a copy in Google Slides
Price
Free
Slides
5
Difficulty
Intermediate
Updated
November 8, 2026

Every slide (5)

Overview

A visitor's message arrives from the web widget or a messaging channel and passes the chat API gateway, which checks the caller and rate limits it. The chat service sends the text to the moderation filter, loads the session history from the session store, and runs a semantic search over the knowledge base. The LLM writes a reply only from the returned passages. The reply is moderated again, saved, and sent back through the gateway to the channel.

The model never receives the raw customer record. It sees the passages and a session id, and each reply logs the passage ids it used, so a bad answer traces back to one article. The main trade-off is handoff. A confidence threshold sends weak answers to the human agent console, and a team running this should review those escalations each week and adjust the threshold.

Useful for

  • Answering product questions from help centre articles on a website
  • Deflecting routine support tickets while keeping a route to staff
  • Adding one bot backend to a web widget and a messaging channel

What's included

  • A designed cover slide
  • The diagram: 10 components and 9 connections as editable shapes
  • A components table and the 8-step data flow
  • A legend with notes
  • The same diagram as a draw.io (diagrams.net) file

How to use it

  1. 1

    Click Make a copy in Google Slides, then confirm on the Google page. The copy is saved to your own Google Drive.

  2. 2

    Rename Web chat widget, Messaging channel, Chat API gateway and the other boxes inside Channels to your own components, and delete the ones your system does not have.

  3. 3

    Rewrite the 8-step data flow and the 8-row components table so they match the arrows you keep.

  4. 4

    For the draw.io version, download ai-chatbot-architecture-diagram.drawio and open it at app.diagrams.net.

What you need

Requirements

  • A Google account for Google Slides, or the free draw.io (diagrams.net) editor

Works with

  • Google Slides
  • Microsoft PowerPoint (File → Download → .pptx)
  • draw.io / diagrams.net (.drawio file)

Questions

Why does the chat service run moderation before the LLM sees a message?

Input is screened first, so abusive text is blocked before any model reads it. The reply is screened again on the way out, which masks card numbers and national ids.

How does the bot decide to hand over to a person?

The chat service escalates when its confidence is low or when the visitor asks for a person. It passes the full transcript, the bot's summary and the visitor's details to the agent console, so the visitor does not repeat themselves.

Why keep only the last 20 turns in the session store?

A short window keeps each prompt small and the cost predictable. The session store also expires idle conversations after 30 minutes.

  • #ai-architecture-diagram
  • #architecture-diagram
  • #google-slides
  • #drawio
  • #diagram-template
  • #free-template

More ai architecture diagram templates

See all 12

Also in Developer workflows

All developer workflows templates
Get this template

Preparing your template…