Visualize AI events in real-time from Azure Video Analyzer using Power BI

Published Sep 17 2021 09:00 AM 1,423 Views
Microsoft

Ever wondered how you could improve your business dashboards with real-time visualization of AI inference events combined with a video playback experience? 

 

Globally cities are becoming smarter by leveraging cameras and real time analytics to manage highway congestion. Identifying traffic peaks locally, understanding these peaks across the entire city and managing the traffic routing in real time needs scalable video analytics as well as intuitive and aesthetically pleasing visualization infrastructure. This is where the power of Azure Video Analyzer with Microsoft Power BI comes to the fore.  

 

In this blog we will use Video Analyzer's new capability called Line Crossing which allows you to define a virtual line on a sample highway video and then count the number of vehicles crossing this virtual line. Using Video Analyzer, you can publish the results of this analysis to IoT Edge Hub in the form of AI inference events. These AI inferences can then be routed to Power BI via Azure Stream Analytics to gain insights and share dashboards with peers in your organization. 

 

Overview of steps to create dashboard from AI events in Power BI:

  1. Create and run a Stream Analytics job to retrieve necessary data from IoT Hub and send to Power BI
  2. Run a live pipeline within Video Analyzer that generates AI inference events and pushes them to the IoT Hub
  3. Create a Power BI dashboard to visualize the AI inference events
  4. Optionally embed the Video Analyzer player widget in the same dashboard

 

Detailed instructions:

  • Step-by-step instructions in the form of a complete tutorial can be found here. 
  • Step-by-step instructions to embed player widget can be found here. 

Follow the two articles to create a dashboard as shown in the screenshot below - 

dashboard-with-widget-and-report.png

 

 

%3CLINGO-SUB%20id%3D%22lingo-sub-2759139%22%20slang%3D%22en-US%22%3EVisualize%20AI%20events%20in%20real-time%20from%20Azure%20Video%20Analyzer%20using%20Power%20BI%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-2759139%22%20slang%3D%22en-US%22%3E%3CP%3E%3CEM%3E%3CSTRONG%3E%3CSPAN%20class%3D%22TextRun%20SCXW60873379%20BCX8%22%20data-contrast%3D%22none%22%3E%3CSPAN%20class%3D%22NormalTextRun%20SCXW60873379%20BCX8%22%3EEver%20wondered%20how%20you%20could%20improve%20your%20business%20dashboards%20with%20real-time%20visualization%20of%20AI%20inference%20events%26nbsp%3B%3C%2FSPAN%3E%3CSPAN%20class%3D%22NormalTextRun%20SCXW60873379%20BCX8%22%3Ecombined%3C%2FSPAN%3E%3CSPAN%20class%3D%22NormalTextRun%20SCXW60873379%20BCX8%22%3E%26nbsp%3Bwith%20a%20video%20playback%20experience%3F%3C%2FSPAN%3E%3C%2FSPAN%3E%3C%2FSTRONG%3E%3C%2FEM%3E%3CSPAN%20class%3D%22EOP%20SCXW60873379%20BCX8%22%20data-ccp-props%3D%22%7B%26quot%3B201341983%26quot%3B%3A0%2C%26quot%3B335559739%26quot%3B%3A160%2C%26quot%3B335559740%26quot%3B%3A259%7D%22%3E%26nbsp%3B%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%3CSPAN%3EGlobally%20cities%20are%20becoming%20smart%3C%2FSPAN%3E%3CSPAN%3Eer%20by%26nbsp%3B%3C%2FSPAN%3E%3CSPAN%3Eleveraging%20cameras%26nbsp%3B%3C%2FSPAN%3E%3CSPAN%3Eand%20real%20time%20ana%3C%2FSPAN%3E%3CSPAN%3Elytics%20to%20manage%20highway%20congestion.%26nbsp%3B%3C%2FSPAN%3E%3CSPAN%3EIdentifying%20traffic%20peaks%20locally%2C%26nbsp%3B%3C%2FSPAN%3E%3CSPAN%3Eunderstanding%20these%3C%2FSPAN%3E%3CSPAN%3E%26nbsp%3Bpeaks%20across%20the%20entire%20city%20and%26nbsp%3B%3C%2FSPAN%3E%3CSPAN%3Emanaging%20the%20tr%3C%2FSPAN%3E%3CSPAN%3Eaffic%20routing%20in%20real%20time%20needs%26nbsp%3B%3C%2FSPAN%3E%3CSPAN%3Escalable%26nbsp%3B%3C%2FSPAN%3E%3CSPAN%3Evideo%20analytics%26nbsp%3B%3C%2FSPAN%3E%3CSPAN%3Eas%20well%20as%20intuitive%20and%26nbsp%3B%3C%2FSPAN%3E%3CSPAN%3Eaesthetically%20pleasing%26nbsp%3B%3C%2FSPAN%3E%3CSPAN%3Evisualization%26nbsp%3B%3C%2FSPAN%3E%3CSPAN%3Einfrastructure.%26nbsp%3B%3C%2FSPAN%3E%3CSPAN%3EThis%20is%20where%20the%20power%20of%20%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Fazure-video-analyzer%2Fvideo-analyzer-docs%2Foverview%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%22%3EAzure%20Video%20Analyzer%3C%2FA%3E%20with%20%3CA%20href%3D%22https%3A%2F%2Fpowerbi.microsoft.com%2F%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%22%3EMicrosoft%20Power%20BI%3C%2FA%3E%20comes%20to%20the%20fore.%26nbsp%3B%3C%2FSPAN%3E%3CSPAN%20data-ccp-props%3D%22%7B%26quot%3B201341983%26quot%3B%3A0%2C%26quot%3B335559739%26quot%3B%3A160%2C%26quot%3B335559740%26quot%3B%3A259%7D%22%3E%26nbsp%3B%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%20data-unlink%3D%22true%22%3E%3CSPAN%3EIn%20this%20blog%20we%20will%20%3CSPAN%20class%3D%22TextRun%20%20BCX8%20SCXW31822173%22%20data-contrast%3D%22none%22%3E%3CSPAN%20class%3D%22NormalTextRun%20%20BCX8%20SCXW31822173%22%3Euse%20Video%20Analyzer's%3C%2FSPAN%3E%3C%2FSPAN%3E%3CSPAN%20class%3D%22TextRun%20%20BCX8%20SCXW31822173%22%20data-contrast%3D%22none%22%3E%3CSPAN%20class%3D%22NormalTextRun%20%20BCX8%20SCXW31822173%22%3E%26nbsp%3Bnew%20capability%20called%26nbsp%3B%3C%2FSPAN%3E%3C%2FSPAN%3E%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Fazure-video-analyzer%2Fvideo-analyzer-docs%2Fuse-line-crossing%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%22%3E%3CSPAN%20class%3D%22TextRun%20Underlined%20%20BCX8%20SCXW31822173%22%20data-contrast%3D%22none%22%3E%3CSPAN%20class%3D%22NormalTextRun%20%20BCX8%20SCXW31822173%22%20data-ccp-charstyle%3D%22Hyperlink%22%3ELine%20Crossing%3C%2FSPAN%3E%3C%2FSPAN%3E%3C%2FA%3E%26nbsp%3B%3CSPAN%20class%3D%22TextRun%20%20BCX8%20SCXW31822173%22%20data-contrast%3D%22none%22%3E%3CSPAN%20class%3D%22NormalTextRun%20%20BCX8%20SCXW31822173%22%3Ewhich%26nbsp%3B%3C%2FSPAN%3E%3CSPAN%20class%3D%22NormalTextRun%20%20BCX8%20SCXW31822173%22%3Eallows%20you%20to%20define%20a%20virtual%20line%26nbsp%3B%3C%2FSPAN%3E%3CSPAN%20class%3D%22NormalTextRun%20%20BCX8%20SCXW31822173%22%3Eon%20a%20sample%20highway%20video%20and%20then%20count%20the%20number%20of%20vehicles%20crossing%20this%20virtual%20line.%26nbsp%3B%3C%2FSPAN%3E%3C%2FSPAN%3E%3C%2FSPAN%3E%3CSPAN%20data-contrast%3D%22none%22%3EUsing%20Video%20Analyzer%2C%26nbsp%3Byou%20can%26nbsp%3Bpublish%26nbsp%3Bthe%20results%20of%20this%20analysis%26nbsp%3Bto%26nbsp%3B%3C%2FSPAN%3E%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Fiot-edge%2Fiot-edge-runtime%3Fview%3Diotedge-2020-11%26amp%3Bpreserve-view%3Dtrue%2522%2520%5Cl%2520%2522iot-edge-hub%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%22%3E%3CSPAN%3EIoT%20Edge%20Hub%3C%2FSPAN%3E%3C%2FA%3E%3CSPAN%20data-contrast%3D%22none%22%3E%26nbsp%3Bin%20the%20form%20of%20AI%20inference%20events.%26nbsp%3BThese%20AI%20inferences%26nbsp%3Bcan%20then%20be%26nbsp%3Brouted%20to%20Power%20BI%3C%2FSPAN%3E%3CSPAN%20data-contrast%3D%22none%22%3E%26nbsp%3Bvia%26nbsp%3B%3C%2FSPAN%3E%3CA%20href%3D%22https%3A%2F%2Fazure.microsoft.com%2Fservices%2Fstream-analytics%2F%23overview%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%22%3E%3CSPAN%20data-contrast%3D%22none%22%3EAzure%20Stream%20Analytics%3C%2FSPAN%3E%3C%2FA%3E%3CSPAN%20data-contrast%3D%22none%22%3E%26nbsp%3Bto%20gain%20insights%20and%20share%20dashboards%20with%20peers%20in%20your%20organization.%3C%2FSPAN%3E%3CSPAN%20data-ccp-props%3D%22%7B%26quot%3B201341983%26quot%3B%3A0%2C%26quot%3B335559739%26quot%3B%3A160%2C%26quot%3B335559740%26quot%3B%3A259%7D%22%3E%26nbsp%3B%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%20data-unlink%3D%22true%22%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%3CSTRONG%3EOverview%20of%26nbsp%3Bsteps%26nbsp%3Bto%20create%20dashboard%20from%20AI%20events%20in%20Power%20BI%3A%3C%2FSTRONG%3E%3C%2FP%3E%0A%3COL%3E%0A%3CLI%3ECreate%20and%20run%20a%20Stream%20Analytics%20job%20to%20retrieve%20necessary%20data%20from%20IoT%20Hub%20and%20send%20to%20Power%20BI%3C%2FLI%3E%0A%3CLI%3ERun%20a%20live%20pipeline%20within%20Video%20Analyzer%20that%20generates%20AI%20inference%20events%20and%20pushes%20them%20to%20the%20IoT%20Hub%3C%2FLI%3E%0A%3CLI%3ECreate%20a%20Power%20BI%20dashboard%20to%20visualize%20the%20AI%20inference%20events%3C%2FLI%3E%0A%3CLI%3EOptionally%20embed%20the%20Video%20Analyzer%20player%20widget%20in%20the%20same%20dashboard%3C%2FLI%3E%0A%3C%2FOL%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%3CSTRONG%3EDetailed%20instructions%3A%3C%2FSTRONG%3E%3C%2FP%3E%0A%3CUL%3E%0A%3CLI%3E%3CSTRONG%3E%3CI%3E%3CSPAN%20data-contrast%3D%22none%22%3EStep-by-step%20instructions%20in%20the%20form%20of%20a%20complete%20tutorial%20can%20be%20found%26nbsp%3B%3C%2FSPAN%3E%3C%2FI%3E%3C%2FSTRONG%3E%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Fazure-video-analyzer%2Fvideo-analyzer-docs%2Fvisualize-ai-events-power-bi%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%22%3E%3CSTRONG%3E%3CI%3E%3CSPAN%20data-contrast%3D%22none%22%3Ehere%3C%2FSPAN%3E%3C%2FI%3E%3C%2FSTRONG%3E%3C%2FA%3E%3CSTRONG%3E%3CI%3E%3CSPAN%20data-contrast%3D%22none%22%3E.%3C%2FSPAN%3E%3C%2FI%3E%3C%2FSTRONG%3E%3CSPAN%20data-ccp-props%3D%22%7B%26quot%3B201341983%26quot%3B%3A0%2C%26quot%3B335559739%26quot%3B%3A160%2C%26quot%3B335559740%26quot%3B%3A259%7D%22%3E%26nbsp%3B%3C%2FSPAN%3E%3C%2FLI%3E%0A%3CLI%3E%3CSTRONG%3E%3CI%3EStep-by-step%20instructions%20to%20embed%20player%20widget%20can%20be%20found%26nbsp%3B%3C%2FI%3E%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fen-us%2Fazure%2Fazure-video-analyzer%2Fvideo-analyzer-docs%2Fembed-player-in-power-bi%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%22%3E%3CI%3Ehere.%3C%2FI%3E%3C%2FA%3E%26nbsp%3B%3C%2FSTRONG%3E%3C%2FLI%3E%0A%3C%2FUL%3E%0A%3CP%3E%3CEM%3EFollow%20the%20two%20articles%20to%20create%20a%20dashboard%20as%20shown%20in%20the%20screenshot%20below%20-%26nbsp%3B%3C%2FEM%3E%3C%2FP%3E%0A%3CP%3E%3CEM%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-inline%22%20image-alt%3D%22dashboard-with-widget-and-report.png%22%20style%3D%22width%3A%20999px%3B%22%3E%3CIMG%20src%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F310985iD36EB092FF6D3B53%2Fimage-size%2Flarge%3Fv%3Dv2%26amp%3Bpx%3D999%22%20role%3D%22button%22%20title%3D%22dashboard-with-widget-and-report.png%22%20alt%3D%22dashboard-with-widget-and-report.png%22%20%2F%3E%3C%2FSPAN%3E%3C%2FEM%3E%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-TEASER%20id%3D%22lingo-teaser-2759139%22%20slang%3D%22en-US%22%3E%3CP%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-inline%22%20image-alt%3D%22dashboard-with-widget-and-report.png%22%20style%3D%22width%3A%20999px%3B%22%3E%3CIMG%20src%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F310983iEE650829794F1171%2Fimage-size%2Flarge%3Fv%3Dv2%26amp%3Bpx%3D999%22%20role%3D%22button%22%20title%3D%22dashboard-with-widget-and-report.png%22%20alt%3D%22dashboard-with-widget-and-report.png%22%20%2F%3E%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3EVisualize%20AI%20events%20in%20real-time%20in%20combination%20with%20a%20video%20playback%20experience%20from%20Azure%20Video%20Analyzer%20on%20a%20Microsoft%20Power%20BI%20dashboard%3C%2FP%3E%3C%2FLINGO-TEASER%3E%3CLINGO-LABS%20id%3D%22lingo-labs-2759139%22%20slang%3D%22en-US%22%3E%3CLINGO-LABEL%3EAzure%20IoT%20Edge%3C%2FLINGO-LABEL%3E%3CLINGO-LABEL%3EAzure%20IoT%20Hub%3C%2FLINGO-LABEL%3E%3CLINGO-LABEL%3EAzure%20Stream%20Analytics%3C%2FLINGO-LABEL%3E%3CLINGO-LABEL%3EAzure%20Video%20Analyzer%3C%2FLINGO-LABEL%3E%3CLINGO-LABEL%3EPower%20BI%3C%2FLINGO-LABEL%3E%3C%2FLINGO-LABS%3E
Co-Authors
Version history
Last update:
‎Sep 17 2021 09:14 AM
Updated by: