Measure usage and impact of Copilot and agents

That is a really good question - currently we classify any interaction from the end user with Copilot chat or other in-app Copilot features as an action. With automatically-generated Copilot insights such as Intelligent Recap or auto-summarizations in Word, an action is only counted if the user viewed the results from Copilot, such as expanding the document summary. This metric might also include Copilot actions taken using Copilot features that are not available in the Copilot Dashboard or analyst workbench as standalone metrics. (Viva Insights' individual Copilot metrics don't provide a comprehensive view of all Copilot features and total actions taken.)

We currently don't have an automated way or metric to show when Copilot does not give a useful answer. If you have more feedback on why you would to measure this and what actions it would help your organization take, I would be happy to provide it as feedback to the product team.