Event banner
Event details
16 Comments
- Sarah_Gilbert
Community Manager
That’s a wrap—thank you all for joining us!
This AMA on measuring usage and impact of Copilot and agents has now concluded, but comments will remain open for the next couple of days so you can still ask follow-up questions or add to existing threads.
You can continue to view all questions and answers on this page—feel free to bookmark it for reference as you track and report on Copilot adoption in your org.
Looking for the session deck?
All decks from this series will be posted publicly on a new Copilot Control System page on adoption.microsoft.com. That page is still in development and is expected to go live Thursday morning. If you’re looking for a copy of today’s deck, please check back here on Thursday for a direct link.
Have more questions?
Visit the Microsoft 365 Copilot Discussion Space to keep the conversation going.
To stay up to date, subscribe to the What’s New in Copilot blog—published at the end of each month.
Up next in the Digital Deep Dive series:
Practical guidance for AI and collaboration adoption
We hope to see you there!
Where is the Copilot dashboard located at?
Thank you!
Who has the ability to Publish the new CoPilot reports that were shown in the demo?
- Sanjanaa_Ellur
Microsoft
It depends on the report you are referring to:
- The Copilot dashboard: Access to this can be granted by an AI admin: https://learn.microsoft.com/en-us/viva/insights/advanced/admin/manage-settings-copilot-dashboard#manage-access-for-individual-users-and-groups:~:text=365%20Global%20Administrators.-,Manage%20access%20for%20individual%20users%20and%20groups,-Applies%20to%3A%20AI
- The analyst workbench with Copilot Adoption, Impact and Agents Power BI templates can be accessed by a Viva Insights Analyst role which is granted by the global admin. The Analyst can then publish it to other users.
- Publish reports: Publish reports | Microsoft Learn
- Roles: Assign roles | Microsoft Learn
How many Copilot Licenses do we require in our tenant to view the Copilot Dashboards?
- Sanjanaa_Ellur
You need to have 50+ assigned M365 Copilot licenses to view the premium Copilot dashboard and you can view the seeded capabilities with less than 50. https://learn.microsoft.com/en-us/viva/insights/org-team-insights/copilot-dashboard#feature-availability-based-on-licenses
Is the usage of agents created with Copilot Studio that are used by users without a Microsoft 365 Copilot license also taken into account in all the analytics shown to estimate ROI?
- Sanjanaa_Ellur
Yes, it will be!
But i understood differently from the explanation.
WueraPopWha is considered as Copilot action? How do you identify those Copilot actions that really helped the user and exclude those when Copilot does not give a useful answer?
- Sanjanaa_Ellur
That is a really good question - currently we classify any interaction from the end user with Copilot chat or other in-app Copilot features as an action. With automatically-generated Copilot insights such as Intelligent Recap or auto-summarizations in Word, an action is only counted if the user viewed the results from Copilot, such as expanding the document summary. This metric might also include Copilot actions taken using Copilot features that are not available in the Copilot Dashboard or analyst workbench as standalone metrics. (Viva Insights' individual Copilot metrics don't provide a comprehensive view of all Copilot features and total actions taken.)
We currently don't have an automated way or metric to show when Copilot does not give a useful answer. If you have more feedback on why you would to measure this and what actions it would help your organization take, I would be happy to provide it as feedback to the product team.
- Sarah_Gilbert
Welcome, everyone!
Thanks for joining today’s Microsoft 365 Copilot Ask Microsoft Anything (AMA)! This session is all about measuring usage, adoption, and the impact of Copilot and agents—giving adoption specialists, IT admins, and organizational leaders the insights they need to track real-world value.
We’ll be covering:
- How to use Copilot Analytics to understand usage patterns and drive adoption
- Best practices for measuring the impact of AI across your org
- New and upcoming product experiences designed to support AI value tracking
- How data can guide your next steps with Copilot and agents
To participate:
Please post your questions in a new comment thread below. Our Microsoft product team is here live and ready to answer your questions throughout the hour.
Let’s get started—ask us anything!
