Event details
We are excited to announce the Microsoft 365 Copilot: Wave 2 AMA on Thursday, September 19 at 9:00 AM Pacific Time! This is your opportunity to ask our team of experts questions following ...
Sarah_Gilbert
Updated Sep 19, 2024
For Copilot Agents (tool calling) , is there a way to measure the quality of the tool selection ?
Did Copilot select the tool(s) we expected it to use for a certain scenario ?
Can we inspect the history of toolcalling in an audit log or something ?
Can we also see (related to the other comment) that the end user has given consent (pressed the button) to perform the actual operation?
- sebastienlevert
Microsoft
Yes. Every call can be inspected by the user calling the API plugin using the plugin developer information card. More info on debugging API plugins here: https://learn.microsoft.com/en-us/microsoft-365-copilot/extensibility/debugging-copilot-plugin- That is per conversation, right ? That in itself is valuable but I am also looking for a way to get some statistics, that is information on all calls, and a bit harder also the calls where our plugin was an option but another was preferred to call
