Once people start using an agent you've built, their experience becomes an important guide to what you do next. Usage can tell you whether the agent is gaining traction but deciding how to improve it takes more than a count of active users. You need to understand what people find useful and where they want something different.
That's where feedback helps. A thumbs up or thumbs down gives you a signal; a verbatim comment can add the context behind it. Looking across those responses would help you choose a change to make, test it, and learn from what users say next. The value is in making that an ongoing part of how you can continually improve your agent.
Microsoft 365 Insights Agent brings submitted feedback into a conversation in Microsoft 365 Copilot Chat. Your agent owners can ask about ratings and verbatim and explore recurring themes. The feedback experience described here is part of Insights Agent V2 (Frontier), an early-access preview, rather than the existing usage-analytics release.
Frontier features are subject to change, and access depends on your organization's configuration and the requirements for the feature. Review the Microsoft Frontier program requirements with your admin before trying the preview.
Give makers feedback, with admins in control
For that improvement cycle to work, makers need access to feedback about their agents. IT admins make this possible by enabling feedback sharing and deciding which agents it applies to.
In the Microsoft 365 admin center, go to Agents > Settings > Agent feedback sharing. Choose All agents or Selected agents to allow sharing according to your organization's requirements, or No agents to disable sharing. If you choose Selected agents, select the agents whose feedback you want to share. Select Save to apply your choice.
Use the agent feedback sharing guidance to review the setting's scope and how it relates to users submitting ratings and verbatim.
Start with what users are telling you
If you have access to the Frontier preview and your admin has enabled sharing for an agent you own, open Microsoft 365 Copilot Chat, search for Insights Agent V2 (Frontier) in the agent picker, and choose Add.
Start with verbatim comments about an agent you own. In these prompt patterns, replace [Agent Name] with that agent's name:
Show me recent verbatim comments for [Agent Name].
Then ask about ratings over a specific period:
How many thumbs up and thumbs down did [Agent Name] get this week?
Insights Agent reports the response count and time window, giving you context for what you're seeing. To look for recurring observations across that feedback, ask:
Summarize the feedback themes for [Agent Name].
Use the summary as a starting point and review the original verbatim comments alongside it before deciding what to change. A theme summary is an AI-generated synthesis, not a substitute for reading the feedback.
If several verbatim comments describe an answer as unclear, for example, you could review the relevant instructions or knowledge, make a change, and test the result.
See the adoption picture
Feedback tells you what users have chosen to share. Usage analytics adds another perspective: which agents are being used and how adoption is changing across your tenant.
Start broadly:
Which agents have the highest usage this week?
Then explore an agent's trend or compare it with another. Use the names of agents you have access to in place of [Agent Name], [Agent A], and [Agent B]:
What's the weekly active user trend for [Agent Name]?
Compare adoption between [Agent A] and [Agent B].
Insights Agent returns supported metrics with the underlying numbers, including daily, weekly, and monthly active users, unique-user trends, adoption growth, and agent comparisons. You can also ask about stickiness: daily active users divided by monthly active users.
Admins can review these signals as one input when evaluating adoption or considering a rollout, alongside their organization's other evidence and requirements.
The usage questions here focus on active-user counts and adoption trends. Read those signals alongside feedback rather than treating usage alone as a measure of quality or business value.
For setup and usage examples, see the Microsoft 365 Insights Agent quickstart.
Make feedback part of your next iteration
IT admins: Review Microsoft Frontier program requirements and your organization's feedback-sharing policies, then enable Agent feedback sharing for the appropriate agents.
Makers and agent owners: If you're eligible for the preview, coordinate with your admin, add Insights Agent V2 (Frontier), and explore feedback for an agent you own. Choose one area to investigate, test a change, and review subsequent feedback. If you use Agent Builder, the guide to building and refining agents explains how to update instructions or knowledge and try your changes.
Explore the Insights Agent documentation for usage analytics. The feedback experience is an early-access Frontier preview, subject to change, and access depends on your organization's configuration and feature requirements. Use the https://aka.ms/InsightsAgentFrontier only after your admin confirms your eligibility and that the destination is the preview release described here. Report any issues you find in our tracker here https://aka.ms/insights-agent-issue-tracker
Microsoft