Forum Discussion
Confidential messages in Copilot Studio
Hello everyone,
I have an agent built in Copilot Studio that uses SharePoint Lists as knowledge sources.
When I access the "Monitor" section, I can view the engagement metrics. Under "User questions", I noticed that some questions were not answered by the agent.
When I try to view more details about these interactions, I encounter the situation shown in the attached image. Copilot Studio does not allow me to view the response provided by the agent to the user. Instead, the response is displayed as "The agent's response is hidden due to sensitive content."
Why is the agent's response displayed as "Confidential"? Is there any configuration or permission that I need to change in order to view these responses?
Is there another way to access the complete interaction history, including the user's question and the response generated by the agent?
I need to analyze the responses provided by the agent to users in order to understand why some questions are not being answered correctly.
Has anyone experienced this issue or knows how to resolve it?
Thank you in advance for your help!
2 Replies
- sohnashIron Contributor
Hello amanda1906, I was exploring this same issue last week as I was also tracking agent responses under Monitor, I used to be able to see them before but now they started appearing as REDACTED in my case.
Here is the explanation from Microsoft (sending 2 links for your reference) - it looks this changed a couple of months ago and now responses are not stored in conversation transcripts - which is why now they either show as REDACTED or "Agent response is hidden due to sensitive content."
Reference 1 - https://learn.microsoft.com/en-us/microsoft-copilot-studio/nlu-generative-answers-sharepoint-onedrive
Reference 2 - https://learn.microsoft.com/en-us/answers/questions/5966975/why-are-some-copilot-studio-session-transcript-res
What to do now
Using Application Insights and in the agent settings turn on "Log sensitive properties" in addition to the rest. This method involved setting up a resource in Application Insights at the Admin side from where you can then get the Connection string.
I haven't tried implementing this yet but when I do, I'd be happy to report back with updates
- Toby-from-VazeCopper Contributor
I'd first separate two questions: did the user receive no answer, or did the user receive an answer that is hidden only in Monitor? A hidden transcript response doesn't by itself establish that the agent failed to answer.
Microsoft documents environment-level transcript viewing/recording controls, with environment-group rules taking precedence. For viewing transcripts in Power Apps, makers need the Bot Transcript Viewer role. Those are access controls; the documentation doesn't establish that granting that role will reveal a response specifically hidden as sensitive.
https://learn.microsoft.com/en-us/microsoft-copilot-studio/admin-transcript-controls
For the exact warning in your screenshot, I'd reproduce the issue with a non-sensitive test question and SharePoint sample, record the channel, agent harness, session ID and time, and ask Microsoft support whether this is expected redaction for that configuration. Keep real confidential content out of the public ticket discussion.
I wouldn't enable sensitive-data logging just to recover the missing text. Microsoft's sensitive-data guidance has specific channel/harness limits and warns that enabling sensitive logging exposes those values.
https://learn.microsoft.com/en-us/microsoft-copilot-studio/voice-sensitive-data