Blog Post

Azure AI Foundry Blog
15 MIN READ

Building a multimodal, multi-agent system using Azure AI Agent Service and OpenAI Agent SDK

robertrita's avatar
robertrita
Icon for Microsoft rankMicrosoft
Mar 23, 2025

By the end of this blog you will learn how to build a structured, modular conversational AI system using a multi-agent architecture with Azure AI Agent Service and OpenAI Agent SDK. You'll understand how to set up specialized agents—such as Triage, FAQ, Account Management, and Live Agent—to efficiently handle diverse customer interactions by delegating tasks based on user input.

In the rapidly evolving landscape of artificial intelligence (AI), the development of systems that can autonomously interact, learn, and make decisions has become a focal point. A pivotal aspect of t...
Updated Mar 23, 2025
Version 2.0
azure ai search
azure ai studio
azure openai service
arafattehsin's avatar
arafattehsin
Learn Expert
Mar 24, 2025

Thanks for sharing this. Did you just simulate a hand-off scenario or this live agent will actually wait for the inputs to be given by the human?

For example, if the conversation is handed off to the live agent then the agent will wait for human to answer it first and then move forward? I am struggling to run that scenario. 

robertrita's avatar
robertrita
Icon for Microsoft rankMicrosoft
Mar 24, 2025

Hi arafattehsin, thanks for going through the tutorial. Yes, in this demo, the live agent is just another LLM for simulation purposes, but feel free to use a tool to connect to a live chat agent. In this case, you have some code changes to bypass the Triage Agent and have direct routing between the user and the live human agent.