Contributors for this blogpost: Jeet J & Ritaja S
Context & Objective
Over the past year, Gen AI apps have expanded significantly across enterprises. The agentic AI era is here, and the Microsoft ecosystem helps enable end-to-end acceleration of agentic AI apps in production. In this blog, we'll cover how both low-code business analysts and pro-code developers can use the Microsoft stack to build reusable agentic apps for their organizations.
Professionals in the Microsoft ecosystem are starting to build advanced agentic generative AI solutions using Microsoft AI Services and Azure AI Foundry, which supports both open source and industry models. Combined with the advancements in Microsoft Fabric, these tools enable robust, industry-specific applications. This blog post explains how to develop multi-agent solutions for various industries using Azure AI Foundry, Copilot Studio, and Fabric.
Disclaimer: This blogpost is for educational purposes only and walks through the process of using the relevant services without ton of custom code; teams must follow engineering best practices—including development, automated deployment, testing, security, and responsible AI—before any production deployment.
What to expect
In-Focus: Our goal is to help the reader explore specific industry use cases and understand the concept of building multi-agent solutions. In our case, we will focus on the insurance and financial services use case, use Fabric Notebooks to create sample (fake) datasets, utilize simple click-through based workflow to build-and-configure three agents (both on Fabric and Azure AI Foundry), tie them together and offer the solution via Teams or Microsoft Copilot using the new M365 Agents Toolkit.
Out-of-Focus: This blog post will not cover the fundamentals of Azure AI Services, Azure AI Foundry, or the various components of Microsoft Fabric. It also won’t cover the different ways (low-code or pro-code) to build agents, orchestration frameworks (Semantic Kernel, Langchain, AutoGen, etc.) for orchestrating the agents, or hosting options (Azure App Service – Web App, Azure Kubernetes Service, Azure Container Apps, Azure Functions ).
Please review the pointers listed towards the end to gain a holistic understanding of building and deploying mission-critical generative AI solutions.
Logical Architecture of Multi-Agent Solution utilizing Microsoft Fabric Data Agent and Azure AI Foundry Agent.
Fabric & Azure AI Foundry – Pro-code Agentic path
Prerequisites
a. Access to Azure Tenant & Subscription
b. Work with Azure tenant administrator to have appropriate Azure Roles and Capacity to provision Azure Resources (services) and Deploy AI Models in certain regions.
c. A paid F2 or higher Fabric capacity resource – Important to note that the Fabric compute capacity can be paused and resumed. Pause in case you wish to save costs after your learning.
|
|
d. Access Fabric Admin Portal Power BI for enabling these settings
> Fabric data agent tenant settings is enabled.
> Copilot tenant switch is enabled.
> Optional: Cross-geo processing for AI is enabled. (depends on your region and data sovereignty requirements)
> Optional: Cross-geo storing for AI is enabled. (depends on your region)
e. At least one of these: Fabric Data Warehouse, Fabric Lakehouse, one or more Power BI semantic models, or a KQL database with data. This blog post will cover how to create sample datasets using Fabric Notebooks.
f. Power BI semantic models via XMLA endpoints tenant switch is enabled for Power BI semantic model data sources.
Walkthrough/Set-up
- One-time setup for Fabric Workspace and all agents
a) Visit https://app.powerbi.com
Click “New workspace” button to create a new workspace, give it a name and ensure that it is tied/associated to the Fabric Capacity you have provisioned.
b) Click Workspace settings of the newly created Workspace
|
c) Review the information in License info. If the workspace isn’t associated with your newly created Fabric Capacity, please do the proper association (link the Fabric capacity to the workspace) and wait for 5-10 mins.
2. Create an Insurance Agent
a) Create a new Lakehouse in your Fabric Workspace. Change the name to InsuranceLakehouse
b) Create a new Fabric Notebook, assign a name, and associate the Insurance Lakehouse with it.
c) Add the following Pyspark (Python) code-snippets in the Notebook.
i) Faker library for Fabric Notebook
ii) Insurance Sample Dataset in Fabric Notebook
iii) Run both cells to generate the sample Insurance dataset.
d) Create a new Fabric data agent, give it a name and add the Data Source (InsuranceLakehouse).
i) Ensure that the Insurance Lakehouse is added as the data source in the Insurance Fabric data agent.
ii) Click AI instructions button first to paste the sample instructions and finally the Publish button.
iii) Paste the sample instructions in the field.
A churn is represented by number 1. Calculate churn rate as : total number of churns (TC) / (TT) total count of churn entries.
When asked to calculate churn for each policy type then TT should be total count of churn of that policy type e.g Life, legal.
iv) Make sure to hit the Publish button.
v) Capture two values from the URL and store them in secure/private place. We will use them to configure the knowledge source in Azure AI Foundry Agent.
https://app.powerbi.com/groups/<WORKSPACE-ID>/aiskills/<ARTIFACT-ID>?experience=power-bie) Create Azure AI Agent on Azure AI Foundry and use Fabric Data Agent as the Knowledge Source
i) Visit https://ai.azure/com
ii) Create new Azure AI Project and deploy gpt-4o-mini model (as an example model) in the region where the model is available.
iii) Create new Azure AI Foundry Agent by clicking the “New agent” button. Give it a name (for e.g. AgentforInsurance)
iv) Paste the sample Instructions in the Azure AI Agent as follows
Use Fabric data agent tool to answer questions related to Insurance data. Fabric data agent as a tool has access to insurance data tables: Claims (amount, date, status), Customer (age, address, occupation, etc), Policy (premium amount, policy type: life insurance, auto insurance, etc)
v) On the right-hand pane, click “+Add” button next to Knowledge.
vi) Choose an existing Fabric data agent connection or click the new Connection.
vii) In the next dialog, plug-in the values of the Workspace and Artifact ID you captured above,
Ensure that “is secret” is checked, give a name to the connection and hit the Connect button.
viii) Add the Code Interpreter as the tool in the Azure AI Foundry agent by clicking +Add next to Actions and selecting Code Interpreter.
ix) Test the agent by clicking “Try in playground” button
x) To test the Agent, you can try out these sample questions:
What is the churn rate across my different insurance policy types
What’s the month over month claims change in % for each insurance type?
Show me graph view of month over month claims change in % for each insurance type for the year 2025 only
Based on month over month claims change for the year 2025, can you show the forecast for the next 3 months in a graph?
f) Exposing the Fabric data agent to end users: We will explore this in the Copilot Studio Section
Fabric & Copilot Studio – Low-code agentic path
Prerequisites
- For Copilot Studio, you have 3 options to work with:
- Copilot Studio trial or
- Copilot Studio license or
Copilot Studio Pay as you go (connected to your Azure billing). Follow steps here to setup: Copilot Studio licensing - Microsoft Copilot Studio | Microsoft Learn
- Once you have Copilot Studio set up, navigate to https://copilotstudio.microsoft.com/ and start creating a new agent – Click on “create” and then “New Agent”
Walkthrough/Set-up: - Follow steps from “Fabric & Azure AI Foundry section” to create the Fabric Lakehouse and
- You could create the new agent by describing step by step in natural language but for this exercise we will “skip to configure” (button):
- Give the agent a name, add a helpful description (suggestion, add: Agent that has access to Insurance data and helps with data driven insights from Policy, Claims and Customer information). Then add the agent instruction prompt: “Answer questions related to Insurance data, you have access to insurance data agent, use the agent to gather insights from insurance Lakehouse containing customer, policy and claim information.” Finally click on “Create”
- You should have the following setup like below:
- Next, we want to add another agent for this agent to use – in this case this will be our Fabric Data Agent. Click on “Agents”:
- Next click on “Add” and add agent. From the screen click on Microsoft Fabric:
- If you haven’t set-up a connection to Fabric from Copilot Studio, you will be prompted to create a new connection, follow the prompts to sign in with your user and add a connection. Once that is done click “Next” to continue:
- From the Fabric screen, select the appropriate data agent and click “Next”:
- On the next screen, name the agent appropriately and use a friendly description “Agent that answers questions from the insurance lakehouse knowledge, has access to claims, policies and customer information” and finally click on “Add Agent”:
- On the “Tools” section click on refresh to make sure the tool description populates.
- Finally go back to overview and then Start Testing the agent from the side Test Panel. Click on Activity map to see the sequence of events. Type in the following question: “What’s the month over month claims change in % for auto insurance ?”
- You can see the Fabric data agent is called by the Copilot Agent in this scenario to answer your question:
- Now let’s prepare to surface this through Teams. You will need to publish the agent to a channel (in this case, we will use the Teams channel). First, navigate to channels:
- Click on the Teams and M365 Copilot channel and click add. After adding the channel, a pop up will ask you if you are ready to publish the agent:
- To view the app in Teams you need to make sure that you have setup proper policies in Teams. Follow this tutorial: Connect and configure an agent for Teams and Microsoft 365 Copilot - Microsoft Copilot Studio | Microsoft Learn.
- Now your app is available across Teams. Below is an example of how to use it from Teams – make sure you click on “Allow” for the fabric data agent connection:
Fabric & AI Foundry & Copilot Studio – the end to end
We saw how Fabric data agents can be created and utilized in Copilot Studio in a multi-agent setup. In the future, pro-code and low-code agentic developers are expected to work together to create agentic apps, instead of in silos.
So, how do we solve the challenge of connecting all the components together in the same technology stack ? Let’s say a pro-code developer has created a custom agent in AI Foundry. Meanwhile, a low-code business user has put in business context to create another agent that requires access to the agent in AI Foundry. You’ll be pleased to know that Copilot Studio and Azure AI Foundry are becoming more integrated to enable complex, custom scenarios: Copilot Studio will soon release the integration to help with this:
Summary: We demonstrated how one can build a Gen AI solution that allows seamless integration between Azure AI Foundry agents and Fabric data agents. We look forward to seeing what innovative solutions you can build by learning and working closely with your Microsoft contacts or your SI partner. This may include but not limited to:
- Utilizing a real industry domain to illustrate the concepts of building simple multi-agent solution.
- Showcasing the value of combining Fabric data agent and Azure AI agent
- Demonstrating how one can publish the conceptual solution to Teams or Copilot using the new M365 Agents Toolkit.
Note that this blog post focused only on Fabric data agent and Azure AI Foundry Agent Service, but production ready solutions will need to consider Azure Monitor (for monitoring and observability) and Microsoft Purview for data governance.
Pointers to Other Learning Resources
- Ways to build AI Agents: Build agents, your way | Microsoft Developer
- Components of Microsoft Fabric: What is Microsoft Fabric - Microsoft Fabric | Microsoft Learn
- Info on Microsoft Fabric data agent
- Create a Fabric data agent (preview) - Microsoft Fabric | Microsoft Learn
- Fabric Data Agent Tutorial: Fabric data agent scenario (preview) - Microsoft Fabric | Microsoft Learn
- New in Fabric Data Agent: Data source instructions for smarter, more accurate AI responses | Microsoft Fabric Blog | Microsoft Fabric
- Info on Azure AI Services, Models and Azure AI Foundry
- Azure AI Foundry documentation | Microsoft Learn
- What are Azure AI services? - Azure AI services | Microsoft Learn
- How to use Azure AI services in Azure AI Foundry portal - Azure AI Services | Microsoft Learn
- What is Azure AI Foundry Agent Service? - Azure AI Foundry | Microsoft Learn
- Explore Azure AI Foundry Models - Azure AI Foundry | Microsoft Learn
- What is Azure OpenAI in Azure AI Foundry Models? | Microsoft Learn
- Explore model leaderboards in Azure AI Foundry portal - Azure AI Foundry | Microsoft Learn & Benchmark models in the model leaderboard of Azure AI Foundry portal - Azure AI Foundry | Microsoft Learn
- How to use model router for Azure AI Foundry (preview) | Microsoft Learn
- Observability in Generative AI with Azure AI Foundry - Azure AI Foundry | Microsoft Learn
- Trustworthy AI for Azure AI Foundry - Azure AI Foundry | Microsoft Learn
- Cost Management for Models: Plan to manage costs for Azure AI Foundry Models | Microsoft Learn
- Provisioned Throughput Offering: Provisioned throughput for Azure AI Foundry Models | Microsoft Learn
- Extend Azure AI Foundry Agent with Microsoft Fabric
- General guidance on when to adopt, extend and build CoPilot experiences:
- M365 Agents Toolkit
- Choose the right agent solution to support your use case | Microsoft Learn
- Microsoft 365 Agents Toolkit Overview - Microsoft 365 Developer | Microsoft Learn
- Github and Video to offer Azure AI Agent inside Teams or CoPilot via M365 Agents Toolkit
Happy Learning!
Contributors: Jeet J & Ritaja S
Special thanks to reviewers: Joanne W, Amir J & Noah A