Copilot in Azure is now integrated in the Voice and Video Insights dashboard

We’re excited to announce the public preview of Copilot in Azure integrations in the Voice and Video Insights dashboard of your Azure Portal. This dashboard provides overview and debugging guidance on your Azure Communication Services calls. By integrating Copilot, we’ve expanded the capabilities of the existing data visualizations in this dashboard. This Copilot enhancement enables communication developers to chat with Copilot to better identify, understand, and improve calling issues that impact their end-users' calling experiences.

By embedding Copilot in Azure in the Voice and Video Insights dashboard, communication developers get AI-driven, natural-language summaries of their calling insights, tailored to improve their end-user's call experience. These AI-driven conversations enable communication developers to quickly prioritize and focus their call improvement efforts. Instead of reviewing large volumes of public documentation to interpret their call logs, developers can chat with Copilot directly from the dashboard to get personalized guidance on their call issues.

What to expect from your Voice and Video Insights Dashboard

We understand the importance of having Copilot in Azure customized to your debugging workflow and visuals, which is why we’ve built multiple Copilot buttons in the Volume and Reliability tabs to give you starting points for your conversations with Copilot. Each Copilot button starts a conversation based on the visuals you’re reviewing in the dashboard.

Since we know how important it is to quickly get inspiration and understand the types of questions Copilot can help you with as a developer, each Copilot button has a built-in, click-to-run starter prompt. Our customized Copilot experience can be accessed by clicking a Copilot button, which opens a chat panel for you to interact with.

For example, in the Volume section, you can click on the “Ask Copilot about Azure Communication Services SDK” button, or in the User Facing Diagnostics (UFD) section, you can click Ask Copilot for help next to the UFD you want to focus on. Lastly, Copilot suggests follow-up prompts based on the context of your chat, to help you further investigate the issue at hand.

Using Copilot in Azure embedded in Voice and Video Insights

As communication developers, you’re focused on developing and maintaining high-quality calling experiences for your end users. We’re enhancing Copilot in Azure to directly support this core need by providing capabilities such as:

• Track your call usage and details
• Diagnose and reduce call issues

By structuring the Voice and Video Insights features around these key areas, we aim to empower you with AI-driven insights and recommendations that accurately articulate the issues and solutions, streamlining workflows and enhancing your ability to improve your call performance more effectively.

In our public preview, we’re announcing Copilot buttons that help communication developers in two key scenarios:

• Monitor your call composition and update your SDK with Copilot in Azure
• Troubleshoot in-call issues with Copilot in Azure

Monitor your call composition and update your SDK with Copilot in Azure

As a communication developer, you need tools that scale with your organization's growth and increasing solution complexity. The Copilot buttons in the Volume section of Voice and Video Insights offer high-level insights across all calls in your resource.

To quickly understand your call volume and composition visuals you can click the Copilot buttons for explanations and guidance on best practices. You can also learn about recent improvements in the Calling SDK and how to update your SDK for optimal performance.

A communication developer needs to quickly understand the impact of multiple SDKs, so they turn to Copilot to learn how to update to the latest Calling SDK

Troubleshoot in-call issues with Copilot in Azure

We recognize that even the best-designed calling solutions can encounter issues. The User Facing Diagnostics (UFD) section is designed to help you identify and address such issues. Given the multitude of variables that can impact users' call experiences, we provide detailed call data to help pinpoint potential root causes and solutions.

The UFD tab enables you to use Copilot for specific insights about how different types of UFDs affect user experiences. Copilot interprets what each UFD signifies and offers practical advice on mitigating these issues to enhance user satisfaction. Moreover, Copilot can share code samples that help you surface in-call notifications, proactively alerting users to call issues, and suggesting measures like unmuting their microphone to mitigate impact.

A communication developer learns how to troubleshoot microphone issues with Copilot.

How to get started 

We are thrilled to bring you these advanced Copilot integrations, empowering you to achieve greater efficiency and effectiveness in managing and improving your communication services. Stay tuned for ongoing updates and enhancements that further elevate your development experience. Happy coding! 

Learn how to get started with Azure Copilot in Voice and Video Insights.