Event banner
Measuring usage, adoption, and the impact of Microsoft Copilot
Event details
You’ve deployed Copilot for Microsoft 365. Great! Now let’s look at usage, adoption, and the impact across your organization. Explore the Microsoft Copilot Dashboard (Preview) in Viva Insights and the reports available in the Microsoft 365 admin center. We’ll show you how you can use these tools to drive business value.
This session is part of the Copilot for Microsoft 365 Tech Accelerator. Add it to your calendar, RSVP for event reminders, and post your questions and comments below! This session will also be recorded and available on demand shortly after conclusion of the live event. |
- Alan CohenBrass ContributorWhat privileged Entra roles can access the adoption score and AI assistance page in particular?
- GabeHoMicrosoftHey Alan, Adoption Score can be accessed by a number of admin roles, see this article https://learn.microsoft.com/en-us/microsoft-365/admin/adoption/adoption-score?view=o365-worldwide#adoption-score-prerequisites
- SherisaReedCopper ContributorI think it would be great if there was a metric on how many "thumbs down" feedback is submitted compared to "thumbs up" and total actions (because we know most people don't usually give positive feedback if things are working as expected). This may help us understand how effective people are finding the tools. Ex: 100 people using it in Excel, doesn't mean that people are getting a positive benefit from that use vs frustrated they aren't getting the results they want
- Samer_BaroudiMicrosoftHi Sherisa! We hear this request frequently and are actively exploring brining the thumbs up / thumbs down metric into the dashboard experiences we covered today. Thanks so much for your feedback and for joining our session.
- Scott_RoanCopper ContributorA few quick items: Beyond adoption there are a few key items: I didn't see adoption over time... Trend lines seeing my adoption rates as compared to last few months along with impacts. Is there a quick way to identify users with low usage rates to provide training or recoup the license?
- Samer_BaroudiMicrosoftThe Copilot for Microsoft 365 usage report offers the ability to toggle between a Summary view versus a Trend view. Selecting the Trend option will show you an Enabled and Active users time series chart the option to view this for Copilot for Microsoft 365 overall, or on a per Microsoft 365 app basis. As for identifying users with low usage rates, the Usage report offers a user-level detail view showing the Last activity dates. The user-level info is anonymized by default and only a Global admin can expose it.
- tomnewbyCopper ContributorWhen are these features available within the dashboard?
- Samer_BaroudiMicrosoft
Hi Tom! The Microsoft 365 admin center features, namely, Adoption Score AI assistance People Experiences category and the Copilot for Microsoft 365 Usage report are both available in Preview today. You can access these under the Reports section of the Microsoft 365 admin center.
As for the Microsoft Copilot Dashboard (Preview) from Viva Insights, the version that is included with Microsoft 365 subscriptions is available in Public Preview and is available at aka.ms/copilotdashboard.
The version that is included with Viva Insights licenses is in Private Preview to a limited set of preview customers and will be released more broadly soon, however the exact release date has not been communicated as of yet. Feel free to reply here if you have any other questions, and thanks again for tuning into the session today.
- Sarah_GilbertCommunity Manager
Measuring usage, adoption, and the impact of Microsoft Copilot starts soon. Have a question? Post it here in the Comments. To simplify Q&A, please post one question per comment.
- Sarah_GilbertCommunity Manager
Welcome to Measuring usage, adoption, and the impact of Microsoft Copilot! Have a question? Post here in the Comments so we can help. Let’s make this an active Q&A!
- tomnewbyCopper Contributor
what constitutes "usage"? clicking on copilot button, or actioning/prompting copilot?....what is an "intentional action"?
- Heather_PoulsenCommunity Manager
A user is considered active in a given app if they performed an intentional action for an AI-powered capability. For example, if a user selects the Copilot icon in the Word ribbon to open the Copilot chat pane, this does not count towards active usage. However, if the user interacts with the chat pane by submitting a prompt, this action would count towards active usage. Click here for more details.
- tomnewbyCopper ContributorSuper. Thanks Heather!
- JackDuMezIron ContributorAI Assistance and Usage Reports for Copilot for Microsoft 365 - Public Preview to GA: Do you know when these options will be Generally Available? They look to be in Preview at this point without data in one tenant.
- Yana TerukhovaMicrosoftyes, it is still in preview, please refer to the public roadmap for upcoming GA dates.
- JackDuMezIron ContributorThanks. It looks like a target of March 2024: https://www.microsoft.com/en-us/microsoft-365/roadmap?filters=Microsoft%20Copilot%20for%20Microsoft%20365
- Alan CohenBrass ContributorHow does M365 detect what Office update channel each machine has configured? Is it based on access logs?
- DjonesLVSCopper ContributorFor our pilot we just ran a command to update the Registration Key which also pushed an app update. cd C:\Program Files\Common Files\Microsoft Shared\ClickToRun OfficeC2RClient.exe /changesetting Channel=Current OfficeC2RClient.exe /update user
- walter-wodzienBrass Contributoris there a way for end users to see their copilot prompt history? in this link one can only delete the history but not view it https://myaccount.microsoft.com/settingsandprivacy/privacy
- reachrjIron Contributor
In you Copilot Chat in Teams, you can click on Copilot Chats to view your previous prompts or conversations with Copilot
- jrwarwickBrass ContributorVery useful, I like that it has both the prompts and the responses! Although it would be nice to see more than the first 4-6 words of each prompt in the browse section. What is the expected lifetime in this list? I.e., what if, a year from now, I want to go back to my prompts from the year before (maybe some kind of annual task), will the Chats history go back that far? Farther?
- GabeHoMicrosoftHey Walter, users should be able to see their prompt history when using Copilot's Graph-grounded chat function in Teams, Edge sidebar, Microsoft365.com. We don't currently maintain chat history across different sessions for Copilot in the Office apps.
- Bipin-prakashBrass ContributorGoing to copilot.microsoft.com and under the Work tab will give you a recent history of prompts directly entered there. There is no collated list of prompts from different apps (word, excel) that all show up in a central place. Would be a good idea for a feature request! https://techcommunity.microsoft.com/t5/microsoft-copilot-for-service/idb-p/MicrosoftCopilotService-Ideas