Event banner
Event details
We are excited to announce the Microsoft 365 Copilot: Wave 2 AMA on Thursday, September 19 at 9:00 AM Pacific Time! This is your opportunity to ask our team of experts questions following ...
Sarah_Gilbert
Updated Sep 19, 2024
For Copilot Agents (tool calling) , is there a way to measure the quality of the tool selection ?
Did Copilot select the tool(s) we expected it to use for a certain scenario ?
Can we inspect the history of toolcalling in an audit log or something ?
Can we also see (related to the other comment) that the end user has given consent (pressed the button) to perform the actual operation?
sebastienlevert
Microsoft
MicrosoftYes. Every call can be inspected by the user calling the API plugin using the plugin developer information card. More info on debugging API plugins here: https://learn.microsoft.com/en-us/microsoft-365-copilot/extensibility/debugging-copilot-plugin
- That is per conversation, right ? That in itself is valuable but I am also looking for a way to get some statistics, that is information on all calls, and a bit harder also the calls where our plugin was an option but another was preferred to call