Understand agent usage and business value with Copilot Analytics

Microsoft

Apr 23, 2025

Copilot Analytics is our set of reporting capabilities, included with Microsoft 365 Copilot, designed to help organizations measure the impact of AI on their business. Reports are already available to track the usage and impact of Microsoft 365 Copilot. Now it’s time for agents.

The use of AI agents within an organization has tremendous potential to usher in a new era of productivity. As agents get built and used for specific tasks or business processes, new productivity gains and ways of working are unlocked. Organizations need to understand the use of agents as part of their overall management, adoption and investment strategy.

With this lens, we’ve created a set of reports to understand agent usage and maximize their effectiveness: Leadership level reporting to assess agent productivity and impact, and reports for IT admins to help manage agents across the organization.

New Copilot Studio agents report in Viva Insights

Leaders want to understand how agents are impacting productivity and the bottom line. The new Copilot Studio agents report in Viva Insights aggregates custom agents created in Copilot Studio into one report for a strategic view of agents. Users can drill down and see agent usage and satisfaction scores, how your top agents are performing, the success rates of those agents, and more. This report will be available in public preview in early May and generally available in June. We will add reporting for additional agent types in the coming months.

Copilot Studio agents report – Agent adoption summary

A big opportunity for agents is when they are used to make an existing business process more efficient and improve ROI. Agents that focus on a specific process or use case can often be associated with an existing business metric that can be tracked and measured against. Starting in June, the Copilot Studio agents report can be used to correlate agent usage to business metrics. Users can customize the report by uploading their specific business metrics from their systems and discover the business impact of a particular agent.

In the example below we’re drilling down into the business impact of an HR support agent. From this view on the right, we can see that this agent has resulted in a 20% decrease in HR support tickets as agent usage has increased! Furthermore, this agent has resulted in an estimated 4,400 hours saved by agent assisted hours. The agent is resolving 73% of sessions and generating a 3.8/5 satisfaction score. I can now see that this agent is saving my employees time and reducing support tickets which improves by returns.

Copilot Studio agents report – Agent impact

New agent reporting for IT admins in the Microsoft 365 admin center

With Copilot Analytics, we’re taking a comprehensive approach to surfacing Agent related insights in all the right spots – for example the Microsoft 365 admin center is the place where IT admins go to manage Microsoft 365 products for the organization. IT admins need user level reporting to manage agent deployment, security and costs and now they can with Agent reports in the Microsoft 365 admin center.

In the Agent section, view active agents with segmentation by those built by your organization, Microsoft partners and those built by Microsoft. This report can be filtered by summaries and trends and clicked down to view each agent’s individual utility.

This gives you a holistic understanding of which types of agent builds are getting the most usage – and this is only the start of the admin center’s efforts to help you understand which agents are most effective for your purposes.

Exciting updates are on the horizon for agent reporting in the Microsoft 365 admin center. A new report will be soon available in preview, offering enhanced insights into agent usage. This report will provide segmentation by license type and publisher type, allowing admins to distinguish between user-created agents and those built by the organization or from the store.

Agents report in the M365 admin center

Additionally, the report will feature near-real-time alerts for high consumption users, helping admins manage agent costs effectively.

Message consumption in the M365 admin center

With detailed drilldowns at the user, agent, and agent/user pair levels, admins will gain a comprehensive view of agent interactions and usage patterns. These enhancements aim to provide deeper insights and better management of AI agents within the organization.

Conclusion

AI transformation is a journey, and we’re all in it together. We’re constantly adding new features and new metrics within Copilot Analytics to help you better understand agents within the context and needs of your business. Below are additional resources to help you on your way: