Skip to content
Azure OpenAI chat diagram with Entra ID, App Service, AI Search, Functions, Blob Storage and Key Vault icons on a card over a photo

Azure OpenAI Chat Architecture

Presentation template for Google Slides and PowerPoint

Make a copy in Google Slides
Price
Free
Slides
5
Difficulty
Intermediate
Updated
November 8, 2026

Every slide (5)

Overview

An employee signs in through Microsoft Entra ID, and the app validates the token it receives. Each chat message reaches the web app on App Service over HTTPS. The app queries Azure AI Search for the passages most relevant to the question, then sends the question and those passages to an Azure OpenAI chat deployment. The answer returns with links to its sources. In the background, Azure Functions picks up new or changed files from Blob Storage, splits and embeds them, and pushes the chunks into the search index.

The model only sees passages the signed-in user is allowed to read, because the index trims results by the user's Entra ID groups. Secrets stay out of code: App Service, Functions and Search use managed identities, and Key Vault holds the few settings that cannot. Prompts and answers can contain personal data, so logging is kept deliberate. Changing the groups, the index schema and the chunk size would adapt this to another company, after checking regional model availability.

The diagram uses the official Microsoft Azure architecture icons, each labelled with its service name. AWS, Microsoft Azure and Google Cloud names and icons are trademarks of their respective owners, used here only to describe their services. WorkspaceTemplates is not affiliated with them.

Useful for

  • Building an internal policy assistant for HR and IT questions
  • Answering staff questions from a company wiki with source links
  • Testing retrieval-augmented chat before a wider rollout

What's included

  • A designed cover slide
  • The diagram: 9 components and 8 connections as editable shapes
  • A components table and the 6-step data flow
  • A legend with notes
  • The same diagram as a draw.io (diagrams.net) file

How to use it

  1. 1

    Click Make a copy in Google Slides, then confirm on the Google page. The copy is saved to your own Google Drive.

  2. 2

    Rename Employees, Microsoft Entra ID, App Service web app and the other boxes inside Production subscription to your own components, and delete the ones your system does not have.

  3. 3

    Rewrite the 6-step data flow and the 8-row components table so they match the arrows you keep.

  4. 4

    For the draw.io version, download azure-openai-chat-architecture-diagram.drawio and open it at app.diagrams.net.

What you need

Requirements

  • A Google account for Google Slides, or the free draw.io (diagrams.net) editor

Works with

  • Google Slides
  • Microsoft PowerPoint (File → Download → .pptx)
  • draw.io / diagrams.net (.drawio file)

Questions

What does hybrid search add over keyword search alone?

Hybrid search runs a keyword query and a vector query together, then merges the two ranked lists. Keyword search finds exact terms such as policy numbers, and vector search finds passages with a similar meaning. Combining them usually returns more relevant passages for a chat question.

Why does the chat app need a managed identity?

A managed identity lets App Service sign in to Azure AI Search and Azure OpenAI without a password or key stored in configuration. Microsoft Entra ID issues and rotates the credentials. Role assignments then control which calls the app may make.

How do search results respect user permissions?

The index stores the group IDs allowed to read each document. At query time the app filters results to the groups in the signed-in user's token, so the model never receives passages the user could not open. This is called security trimming.

  • #azure-architecture-diagram
  • #architecture-diagram
  • #azure
  • #google-slides
  • #drawio
  • #diagram-template
  • #free-template

More azure architecture diagram templates

See all 9

Also in Developer workflows

All developer workflows templates
Get this template

Preparing your template…