We are excited to share with you some of the latest features that we have added to Azure AI Video Indexer (VI), the video analysis solution that helps you to extract insights from your video and audio files. Here are some of the highlights:
All features in this announcement are delivered as preview features.
Now with more details:
As part of Azure’s adaptive cloud approach mentioned by Satya, we are thrilled to announce that we have released an edge preview version of Azure Video Indexer (VI), enabled by Arc. This version allows you to use the same managed video analysis solution both on cloud and edge, depending on your needs. In this adaptive version, we assume network connectivity is allowed, but the entire AI processing is on your edge appliance while VI is deployed on AKS cluster and the edge device has enough compute. Review Azure Arc Jumpstart to learn how to use VI enabled by Arc on AKS Edge Essentials single node deployment (in preview). The preview version is available starting December 15, 2023. Register here to get access.
Which business problem do we solve with Hybrid Azure AI Video Indexer approach?
Let's use this example - Contoso Supermarket is a retail company that operates worldwide. Some of its sites have CCTV cameras and they would like to use them to optimize their business performance. One of their goals is to detect cars in the parking lot in front of the stores and analyze if there is a correlation between the available parking and the number of orders. This way, they can adjust their inventory, staffing, and marketing strategies accordingly.
However, sending all the video footage from the cameras to the cloud for vehicle analysis would be costly, slow, and not always align with local regulations. Each supermarket has many hours of video recorded every day, which would consume a lot of bandwidth and storage. The video analysis would also take a long time to complete. Moreover, the video data may contain sensitive information about the customers and the employees, which may violate some local regulations or privacy policies.
That is why Contoso Supermarket decided to use the adaptive and hybrid video analysis solution with Azure VI. This solution allows them to run the AI processing on their own edge devices, without sending the video data to the cloud, but only share the results of the indexing with the regional operator that works and manages the region through the cloud.
Image 1: Example of Video Indexer AI pipeline running on edge. Basic video and audio AIs will be available on edge, in addition to the cloud. Custom AI models can be integrated to the insights as well
Microsoft Azure AI delivers the state-of-the-art AIs, but fine-tuning is required for specific vision and audio analysis tasks, such as license plate detection, tattoo detection, special signs in video, specific uniforms/masks and more. Today we announce the bring-your-own AI feature, where you can use models from Hugging Face, Azure Florence, or any other AI model and connect it to VI insights. The models are hosted out of VI. This way, the video analyst can benefit from a single joint experience and can both see the insights on the portal and also search for them. See below how we integrate a custom model of car types with VI insights:
Image 2: example of integration of custom car models AI
We are excited to announce that we have released some new features for Azure VI that will help you to enrich your video metadata and improve your video search experience. These features are:
Image 3: user can add custom video tags under the video player
Limited access features as these features related to people model which is available as part of a gating program for limited access features in Azure AI Video Indexer
We are also happy to announce that we have released new feature set in preview to improve the efficiency and accuracy of customized People model, a gated AI model that allows you to train your own model to recognize specific people in your videos. These features are:
Image 4: Indication on the quality of people model
Image 5: cluster of a detected person face from the video library
Image 6: Search results with max confidence score for identified person name
We hope you enjoy these new features and we look forward to hearing your feedback.
Thank you for choosing Azure VI as your video analysis solution.
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.