Azure AI Video Indexer is now generally available as an Azure Arc-enabled extension, building on Azure's adaptive cloud approach. This approach, enabled by Azure Arc, reduces operational complexity by simplifying the management and security of data, applications, and infrastructure. This eases the adoption of new technology and Edge AI solution, accelerating digital transformation.
In today's evolving digital landscape, organizations are increasingly looking to leverage AI to unlock insights from their data estates and extend indexing operations beyond the cloud to enable cloud-to-edge AI scenarios.
This release empowers our customers to scale their computer vision and audio analysis related AI initiatives. It allows organizations to deploy video and audio analysis capabilities to the locations where insights are needed, while ensuring consistent management and governance across distributed locations.
During the features public preview, customers have shared key scenarios where edge indexing is needed. A common use case is when it would serve costly to transfer vast video archives to cloud-based applications and there is a need for an edge-based content discovery solution. An initial edge indexing can discover and filter content that is of potential value as IP or other monetization. In addition, edge indexing is needed when compliance with data privacy regulations or licensing restrictions requires content remaining private or within defined geographic boundaries.
What is Azure AI Video Indexer extension enabled by Azure Arc?
Azure AI Video Indexer enabled by Azure Arc allows you to run video and audio analysis, as well as generative AI, on devices located in distributed locations such as, but not limited to, Azure Local. This solution is designed to operate on Azure Arc-enabled Kubernetes clusters, supporting a wide range of video formats and languages, making it a versatile tool for global applications. The extension also supports bringing your own pre-trained custom models that customers can incorporate and run as part of Video Indexers insight pipeline.
Enhancements included in the General Availability release
- Expanded language support: Supports transcription in over 35 languages, as well as translation to English.
- Generative AI: Users can create textual video summaries, allowing you to leverage state of the art, multimodal models to generate textual summaries of videos in various styles. It leverages key frames, as well as audio and visual insights, to create comprehensive summaries using Azure the Phi3.5 model. This multi-modal approach ensures a more accurate and contextually rich summary, suitable for various use cases.
- Performance improvements: As part of the GA release, we have made significant performance improvements. These enhancements ensure faster processing times and more efficient resource utilization, providing smoother installation and more responsive experience.
Additional transformative improvements are on their way, and we look forward to sharing them with you in the coming months.
Use cases
Azure AI Video Indexer as an extension enabled by Azure Arc is perfect for a variety of use cases, including:
- Content discovery: Can be used as an edge-based content discovery solution, extracting valuable metadata from vast media archives. This can replace slow and costly manual processes and to determine content that is valuable IP and be monetized.
- Quality control and defect detection: Manufacturers can use Azure AI Video Indexer to analyze recorded footage from production lines to detect defects in products. By leveraging object detection and customizable AI models, the system can identify anomalies or defects in the recorded videos. This can significantly reduce the COGS by minimizing the number of defective products that reach the market. It also saves manual inspection time, allowing workers to focus on more complex tasks.
- Training and process improvement: Recorded videos of manufacturing processes can be analyzed to identify areas for improvement and to train new employees. The system can use speech-to-text capabilities to transcribe and translate training sessions and process explanations. This helps in standardizing training materials, improving process efficiency, and reducing the time required for new employees to become productive.
- Safety and compliance monitoring: Azure AI Video Indexer can be used to monitor safety compliance on the factory floor by analyzing recorded CCTV footage. The system can detect unsafe behaviors, such as workers not wearing protective gear or entering restricted areas. Post-event analysis helps to manage the risk of accidents and ensures compliance with safety regulations.
Learn more about Azure AI Video Indexer
- Visit our overview and QuickStart guide.
- Want to get automated zero-to-hero scenarios? Try the Video Indexer Jumpstart scenario.
- See the Video Indexer GitHub samples.
- Try out the public cloud version Azure AI Video Indexer website to access product website.
- Visit Azure AI Video Indexer Developer Portal to learn about our APIs.
- Review our product documentation.
- Get to know the recent features using Azure AI Video Indexer release notes.
- To report an issue with Azure AI Video Indexer, go to Azure portal Help + support. Create a new support request. Your request will be tracked within SLA.
- For any other question, contact our support distribution list at visupport@microsoft.com
Microsoft