Blog Post

Apps on Azure Blog
5 MIN READ

Build Multi-Agent AI Systems on Azure App Service

jordanselig's avatar
jordanselig
Icon for Microsoft rankMicrosoft
Sep 05, 2025

Continuing our journey of integrating AI agents into existing App Service applications - now with multi-agent architecture, MCP tools, .NET Aspire, and Premium v4.

Introduction: The Evolution of AI-Powered App Service Applications

Over the past few months, we've been exploring how to supercharge existing Azure App Service applications with AI capabilities. If you've been following along with this series, you've seen how we can quickly integrate AI Foundry agents with MCP servers and host remote MCP servers directly on App Service.

Today, we're taking the next leap forward by demonstrating how to build sophisticated multi-agent systems that leverage connected agents, Model Context Protocol (MCP), and OpenAPI tools - all running on Azure App Service's Premium v4 tier with .NET Aspire for enhanced observability and cloud-native development experience.

๐Ÿ’ก Want the full technical details? This blog provides an overview of the key concepts and capabilities. For comprehensive setup instructions, architecture deep-dives, performance considerations, debugging guidance, and detailed technical documentation, check out the complete README on GitHub.

What Makes This Sample Special?

This fashion e-commerce demo showcases several cutting-edge technologies working together:

๐Ÿค– Multi-Agent Architecture with Connected Agents

Unlike single-agent systems, this sample implements an orchestration pattern where specialized agents work together:

  • Main Orchestrator: Coordinates workflow and handles inventory queries via MCP tools
  • Cart Manager: Specialized in shopping cart operations via OpenAPI tools
  • Fashion Advisor: Provides expert styling recommendations
  • Content Moderator: Ensures safe, professional interactions

๐Ÿ”ง Advanced Tool Integration

  • MCP Tools: Real-time connection to external inventory systems using the Model Context Protocol
  • OpenAPI Tools: Direct agent integration with your existing App Service APIs
  • Connected Agent Tools: Seamless agent-to-agent communication with automatic orchestration

โšก .NET Aspire Integration

  • Enhanced development experience with built-in observability
  • Simplified cloud-native application patterns
  • Real-time monitoring and telemetry (when developing locally)

๐Ÿš€ Premium v4 App Service Tier

  • Latest App Service performance capabilities
  • Optimized for modern cloud-native workloads
  • Enhanced scalability for AI-powered applications

Key Technical Innovations

Connected Agent Orchestration
Your application communicates with a single main agent, which automatically coordinates with specialist agents as needed. No changes to your existing App Service code required.

Dual Tool Integration
This sample demonstrates both MCP tools for external system connectivity and OpenAPI tools for direct API integration.

Zero-Infrastructure Overhead
Agents work directly with your existing App Service APIs and external endpoints - no additional infrastructure deployment needed.

Why These Technologies Matter for Real Applications

The combination of these technologies isn't just about showcasing the latest features - it's about solving real business challenges. Let's explore how each component contributes to building production-ready AI applications.

.NET Aspire: Enhancing the Development Experience

This sample leverages .NET Aspire to provide enhanced observability and simplified cloud-native development patterns. While .NET Aspire is still in preview on App Service, we encourage you to start exploring its capabilities and keep an eye out for future updates planned for later this year.

What's particularly exciting about Aspire is how it maintains the core principle we've emphasized throughout this series: making AI integration as simple as possible. You don't need to completely restructure your application to benefit from enhanced observability and modern development patterns.

Premium v4 App Service: Built for Modern AI Workloads

This sample is designed to run on Azure App Service Premium v4, which we recently announced is Generally Available. Premium v4 is the latest offering in the Azure App Service family, delivering enhanced performance, scalability, and cost efficiency.

From Concept to Implementation: Staying True to Our Core Promise

Throughout this blog series, we've consistently demonstrated that adding AI capabilities to existing applications doesn't require massive rewrites or complex architectural changes. This multi-agent sample continues that tradition - what might seem like a complex system is actually built using the same principles we've established:

โœ… Incremental Enhancement: Build on your existing App Service infrastructure
โœ… Simple Integration: Use familiar tools like azd up for deployment
โœ… Production-Ready: Leverage mature Azure services you already trust
โœ… Future-Proof: Easy to extend as new capabilities become available

Looking Forward: What's Coming Next

This sample represents just the beginning of what's possible with AI-powered App Service applications. Here's what we're working on next:

๐Ÿ” MCP Authentication Integration

Enhanced security patterns for production MCP server deployments, including Azure Entra ID integration.

๐Ÿš€ New Azure AI Foundry Features

As Azure AI Foundry continues to evolve, we'll be updating this sample to showcase:

  • New agent capabilities
  • Enhanced tool integrations
  • Performance optimizations
  • Additional model support

๐Ÿ“Š Advanced Analytics and Monitoring

Deeper integration with Azure Monitor for:

  • Agent performance analytics
  • Business intelligence from agent interactions

๐Ÿ”ง Additional Programming Language Support

Following our multi-language MCP server samples, we'll be adding support for other languages in samples that will be added to the App Service documentation.

Getting Started Today

Ready to add multi-agent capabilities to your existing App Service application? The process follows the same streamlined approach we've used throughout this series.

Quick Overview

  1. Clone and Deploy: Use azd up for one-command infrastructure deployment
  2. Create Your Agents: Run a Python setup script to configure the multi-agent system
  3. Connect Everything: Add one environment variable to link your agents
  4. Test and Explore: Try the sample conversations and see agent interactions

๐Ÿ“š For detailed step-by-step instructions, including prerequisites, troubleshooting tips, environment setup, and comprehensive configuration guidance, see the complete setup guide in the README.

Learning Resources

If you're new to this ecosystem, we recommend starting with these foundational resources:

Conclusion: The Future of AI-Powered Applications

This multi-agent sample represents the natural evolution of our App Service AI integration journey. We started with basic agent integration, progressed through MCP server hosting, and now we're showcasing sophisticated multi-agent orchestration - all while maintaining our core principle that AI integration should enhance, not complicate, your existing applications.

Whether you're just getting started with AI agents or ready to implement complex multi-agent workflows, the path forward is clear and incremental. As Azure AI Foundry adds new capabilities and App Service continues to evolve, we'll keep updating these samples and sharing new patterns.

Stay tuned - the future of AI-powered applications is being built today, one agent at a time.


Additional Resources

๐Ÿš€ Start Building

๐Ÿ“š Learn More


Have questions or want to share how you're using multi-agent systems in your applications? Join the conversation in the comments below. We'd love to hear about your AI-powered App Service success stories!

Updated Sep 05, 2025
Version 4.0
No CommentsBe the first to comment