Event banner
Event details
Join us for an exclusive Ask Me Anything (AMA) session focused on Agents in SharePoint on Thursday, January 9th, from 9:00 AM to 10:00 AM PT.
This session will cover pivotal topics such...
Sarah_Gilbert
Updated Jan 06, 2025
cjtan
Microsoft
MicrosoftWe are continuously improving the quality of responses from the SharePoint agents based on how customers are using and the feedback that is given for responses. Be sure to use the Thumbs up/down buttons in the message response window when you see something that works or doesn't work as expected. As an administrator, the information from this feedback can be viewed through Microsoft Admin Center, as well.
Because SharePoint agents have a configuration for "Instructions", you can direct the agent more specifically with instructions to help make the responses more predictable; for example, directions that instruct agent not to use its latent knowledge and only use the selected circumstances. You can use the File Statistics on the .agent file to understand if the agent is being used.
Thanks for the reply. So to understand how the agent is performing I have to look at the feedback provided by the users with the thumbs up/down. Do you plan to add other metrics for evaluating this performance in a more offline way, like metrics for evaluating the faithfulness or groundedness of the responses and the documents, or the relevancy of the responses regarding the questions posed?