Build an AI-powered predictive maintenance solution with TinyML, Azure Sphere, and Microsoft Teams

Published Mar 28 2022 08:44 AM 2,095 Views
Microsoft

ML on embedded hardware

 

AI-powered predictive maintenance can help identify a faulty machine before a real problem occurs, reducing maintenance costs, improving availability and customer satisfaction. The advantages of predictive maintenance include:

  • Reduced carbon footprint. Keeping equipment running well has straightforward benefits for operating efficiency, but we should also ensure our processes are efficient. Fault monitoring can generate high volumes of low-value data. Sending this data to cloud systems consumes power and network resources. Running an ML model on embedded hardware consumes less electricity and network resources. Only predicted maintenance events get sent to the backend systems. Disabling network interfaces (for example, Wi-Fi) can further reduce power consumption until a high-value predictive maintenance event occurs.
  • Access to better data for faster fault resolution.
  • Low latency response to system faults. There are fault monitoring use cases that require immediate action to shut down a system. Sending fault monitoring data to cloud systems for processing might be too slow, further damaging the machine.

 

Predictive maintenance on Azure Sphere

 

Azure Sphere is a secure embedded platform that is ideal for quickly developing an IoT system. By providing a platform meeting all 7 properties of highly secured devices, Azure Sphere eliminates the need to be a hardware, OS, and security expert. These seven properties make Azure Sphere ideal for running and updating ML models. You don’t want to solve one problem (equipment operation) and introduce a larger one (security).

 

You can deploy up to 3 custom apps on Azure Sphere, including two ML workloads on the low-power real-time cores. The predictive maintenance solution runs a continuous movement classification TinyML model on one of the Azure Sphere real-time cores. When the TinyML model detects movement, for example, a rattle, or a faulty motor bearing, an event is sent to the predictive maintenance app running on the high-level core. The predictive maintenance app then powers up the network connection and sends the event to Azure IoT Central. Azure IoT Central exports the predictive maintenance event to a Logic App, which generates a message destined for Microsoft Teams.

 

The beauty of this solution is that you are combining building blocks. You don’t need to be a security expert, Azure Sphere has got you covered, Edge Impulse simplifies model development, and IoT Central, Logic Apps, Microsoft Teams are low code offerings making it easier to pull everything together.

 

The source code and documentation are available on the Azure Sphere Predictive Maintenance Wiki.

 

glovebox_1-1648460943527.png

 

Building the TinyML model

 

The TinyML (TensorFlow Lite) model was built with Edge Impulse. Edge Impulse simplifies building machine learning models for embedded hardware such as Azure Sphere. The cloud service is designed for developers, so you don’t need to be a data science guru. There are tools for ML training data acquisition, and wizards lead you through the process of training, testing, and exporting models. Learn more about Edge Impulse on their getting started page.

 

Predictive maintenance in the cloud

 

Of course, not all embedded hardware can run ML models, or the cost to redeploy updated firmware may outweigh the benefits. If this is your scenario, running cloud-based ML models may be an option. The Azure Anomaly Detector API enables you to monitor and detect abnormalities in time series data. Learn how to Identify abnormal time-series data with Anomaly Detector.

ML Predictive maintenance introduction video

 

Be sure to watch the 10-minute end-to-end demonstration.

 

 

 

Any questions?

 

Please feel free to post any questions you may have.

 

Cheers Dave

1 Comment
%3CLINGO-SUB%20id%3D%22lingo-sub-3268598%22%20slang%3D%22en-US%22%3EBuild%20an%20AI-powered%20predictive%20maintenance%20solution%20with%20TinyML%2C%20Azure%20Sphere%2C%20and%20Microsoft%20Teams%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-3268598%22%20slang%3D%22en-US%22%3E%3CH2%20id%3D%22toc-hId-392954675%22%20id%3D%22toc-hId-416871824%22%3EML%20on%20embedded%20hardware%3C%2FH2%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EAI-powered%20predictive%20maintenance%20can%20help%20identify%20a%20faulty%20machine%20before%20a%20real%20problem%20occurs%2C%20reducing%20maintenance%20costs%2C%20improving%20availability%20and%20customer%20satisfaction.%20The%20advantages%20of%20predictive%20maintenance%20include%3A%3C%2FP%3E%0A%3CUL%3E%0A%3CLI%3EReduced%20carbon%20footprint.%20Keeping%20equipment%20running%20well%20has%20straightforward%20benefits%20for%20operating%20efficiency%2C%20but%20we%20should%20also%20ensure%20our%20processes%20are%20efficient.%20Fault%20monitoring%20can%20generate%20high%20volumes%20of%20low-value%20data.%20Sending%20this%20data%20to%20cloud%20systems%20consumes%20power%20and%20network%20resources.%20Running%20an%20ML%20model%20on%20embedded%20hardware%20consumes%20less%20electricity%20and%20network%20resources.%20Only%20predicted%20maintenance%20events%20get%20sent%20to%20the%20backend%20systems.%20Disabling%20network%20interfaces%20(for%20example%2C%20Wi-Fi)%20can%20further%20reduce%20power%20consumption%20until%20a%20high-value%20predictive%20maintenance%20event%20occurs.%3C%2FLI%3E%0A%3CLI%3EAccess%20to%20better%20data%20for%20faster%20fault%20resolution.%3C%2FLI%3E%0A%3CLI%3ELow%20latency%20response%20to%20system%20faults.%20There%20are%20fault%20monitoring%20use%20cases%20that%20require%20immediate%20action%20to%20shut%20down%20a%20system.%20Sending%20fault%20monitoring%20data%20to%20cloud%20systems%20for%20processing%20might%20be%20too%20slow%2C%20further%20damaging%20the%20machine.%3C%2FLI%3E%0A%3C%2FUL%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CH2%20id%3D%22toc-hId--1414499788%22%20id%3D%22toc-hId--1390582639%22%3EPredictive%20maintenance%20on%20Azure%20Sphere%3C%2FH2%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%3CA%20href%3D%22https%3A%2F%2Fazure.microsoft.com%2Fservices%2Fazure-sphere%2F%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%22%3EAzure%20Sphere%3C%2FA%3E%20is%20a%20secure%20embedded%20platform%20that%20is%20ideal%20for%20quickly%20developing%20an%20IoT%20system.%20By%20providing%20a%20platform%20meeting%20all%20%3CA%20href%3D%22https%3A%2F%2Fwww.microsoft.com%2Fen-us%2Fresearch%2Fuploads%2Fprod%2F2020%2F11%2FSeven-Properties-of-Highly-Secured-Devices-2nd-Edition-R1.pdf%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%22%3E7%20properties%20of%20highly%20secured%20devices%3C%2FA%3E%2C%20Azure%20Sphere%20eliminates%20the%20need%20to%20be%20a%20hardware%2C%20OS%2C%20and%20security%20expert.%20These%20seven%20properties%20make%20Azure%20Sphere%20ideal%20for%20running%20and%20updating%20ML%20models.%20You%20don%E2%80%99t%20want%20to%20solve%20one%20problem%20(equipment%20operation)%20and%20introduce%20a%20larger%20one%20(security).%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EYou%20can%20deploy%20up%20to%203%20custom%20apps%20on%20Azure%20Sphere%2C%20including%20two%20ML%20workloads%20on%20the%20low-power%20real-time%20cores.%20The%20predictive%20maintenance%20solution%20runs%20a%20continuous%20movement%20classification%20TinyML%20model%20on%20one%20of%20the%20Azure%20Sphere%20real-time%20cores.%20When%20the%20TinyML%20model%20detects%20movement%2C%20for%20example%2C%20a%20rattle%2C%20or%20a%20faulty%20motor%20bearing%2C%20an%20event%20is%20sent%20to%20the%20predictive%20maintenance%20app%20running%20on%20the%20high-level%20core.%20The%20predictive%20maintenance%20app%20then%20powers%20up%20the%20network%20connection%20and%20sends%20the%20event%20to%20Azure%20IoT%20Central.%20Azure%20IoT%20Central%20exports%20the%20predictive%20maintenance%20event%20to%20a%20Logic%20App%2C%20which%20generates%20a%20message%20destined%20for%20Microsoft%20Teams.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EThe%20beauty%20of%20this%20solution%20is%20that%20you%20are%20combining%20building%20blocks.%20You%20don%E2%80%99t%20need%20to%20be%20a%20security%20expert%2C%20Azure%20Sphere%20has%20got%20you%20covered%2C%20Edge%20Impulse%20simplifies%20model%20development%2C%20and%20IoT%20Central%2C%20Logic%20Apps%2C%20Microsoft%20Teams%20are%20low%20code%20offerings%20making%20it%20easier%20to%20pull%20everything%20together.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EThe%20source%20code%20and%20documentation%20are%20available%20on%20the%20%3CA%20href%3D%22https%3A%2F%2Fgithub.com%2Fgloveboxes%2FAzureSphereClassify%2Fwiki%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%22%3EAzure%20Sphere%20Predictive%20Maintenance%20Wiki%3C%2FA%3E.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%20align%3D%22center%22%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-inline%22%20image-alt%3D%22glovebox_1-1648460943527.png%22%20style%3D%22width%3A%20791px%3B%22%3E%3CIMG%20src%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F358993iB8DE106EE84CEB64%2Fimage-dimensions%2F791x391%3Fv%3Dv2%22%20width%3D%22791%22%20height%3D%22391%22%20role%3D%22button%22%20title%3D%22glovebox_1-1648460943527.png%22%20alt%3D%22glovebox_1-1648460943527.png%22%20%2F%3E%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CH2%20id%3D%22toc-hId-1073013045%22%20id%3D%22toc-hId-1096930194%22%3EBuilding%20the%20TinyML%20model%3C%2FH2%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EThe%20TinyML%20(TensorFlow%20Lite)%20model%20was%20built%20with%26nbsp%3B%3CA%20href%3D%22https%3A%2F%2Fwww.edgeimpulse.com%2F%22%20target%3D%22_blank%22%20rel%3D%22noopener%20nofollow%20noreferrer%22%3EEdge%20Impulse%3C%2FA%3E.%20Edge%20Impulse%20simplifies%20building%20machine%20learning%20models%20for%20embedded%20hardware%20such%20as%20Azure%20Sphere.%20The%20cloud%20service%20is%20designed%20for%20developers%2C%20so%20you%20don%E2%80%99t%20need%20to%20be%20a%20data%20science%20guru.%20There%20are%20tools%20for%20ML%20training%20data%20acquisition%2C%20and%20wizards%20lead%20you%20through%20the%20process%20of%20training%2C%20testing%2C%20and%20exporting%20models.%20Learn%20more%20about%20Edge%20Impulse%20on%20their%26nbsp%3B%3CA%20href%3D%22https%3A%2F%2Fdocs.edgeimpulse.com%2Fdocs%22%20target%3D%22_blank%22%20rel%3D%22noopener%20nofollow%20noreferrer%22%3Egetting%20started%3C%2FA%3E%26nbsp%3Bpage.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CH2%20id%3D%22toc-hId--734441418%22%20id%3D%22toc-hId--710524269%22%3EPredictive%20maintenance%20in%20the%20cloud%3C%2FH2%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EOf%20course%2C%20not%20all%20embedded%20hardware%20can%20run%20ML%20models%2C%20or%20the%20cost%20to%20redeploy%20updated%20firmware%20may%20outweigh%20the%20benefits.%20If%20this%20is%20your%20scenario%2C%20running%20cloud-based%20ML%20models%20may%20be%20an%20option.%20The%26nbsp%3B%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Fazure%2Fcognitive-services%2Fanomaly-detector%2F%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%22%3EAzure%20Anomaly%20Detector%20API%3C%2FA%3E%26nbsp%3Benables%20you%20to%20monitor%20and%20detect%20abnormalities%20in%20time%20series%20data.%20Learn%20how%20to%26nbsp%3B%3CA%20href%3D%22https%3A%2F%2Fdocs.microsoft.com%2Flearn%2Fmodules%2Fidentify-abnormal-time-series-data-anomaly-detector%2F%22%20target%3D%22_blank%22%20rel%3D%22noopener%20noreferrer%22%3EIdentify%20abnormal%20time-series%20data%20with%20Anomaly%20Detector%3C%2FA%3E.%3C%2FP%3E%0A%3CH2%20id%3D%22toc-hId-1753071415%22%20id%3D%22toc-hId-1776988564%22%3EML%20Predictive%20maintenance%20introduction%20video%3C%2FH2%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EBe%20sure%20to%20watch%20the%2010-minute%20end-to-end%20demonstration.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3E%3CIFRAME%20src%3D%22https%3A%2F%2Fwww.youtube.com%2Fembed%2F62XKxzRld28%22%20width%3D%22560%22%20height%3D%22315%22%20frameborder%3D%220%22%20allowfullscreen%3D%22allowfullscreen%22%20title%3D%22YouTube%20video%20player%22%20allow%3D%22accelerometer%3B%20autoplay%3B%20clipboard-write%3B%20encrypted-media%3B%20gyroscope%3B%20picture-in-picture%22%3E%3C%2FIFRAME%3E%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CH2%20id%3D%22toc-hId--54383048%22%20id%3D%22toc-hId--30465899%22%3EAny%20questions%3F%3C%2FH2%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3EPlease%20feel%20free%20to%20post%20any%20questions%20you%20may%20have.%3C%2FP%3E%0A%3CP%3E%26nbsp%3B%3C%2FP%3E%0A%3CP%3ECheers%20Dave%3C%2FP%3E%3C%2FLINGO-BODY%3E%3CLINGO-TEASER%20id%3D%22lingo-teaser-3268598%22%20slang%3D%22en-US%22%3E%3CP%3E%3CSPAN%20class%3D%22lia-inline-image-display-wrapper%20lia-image-align-inline%22%20image-alt%3D%2268747470733a2f2f75706c6f61642e77696b696d656469612e6f72672f77696b6970656469612f636f6d6d6f6e732f392f39302f526f6f66746f705f5061636b616765645f556e6974732e4a5047.jpeg%22%20style%3D%22width%3A%20400px%3B%22%3E%3CIMG%20src%3D%22https%3A%2F%2Ftechcommunity.microsoft.com%2Ft5%2Fimage%2Fserverpage%2Fimage-id%2F358996i6062A83769FD7D9E%2Fimage-size%2Flarge%3Fv%3Dv2%26amp%3Bpx%3D999%22%20role%3D%22button%22%20title%3D%2268747470733a2f2f75706c6f61642e77696b696d656469612e6f72672f77696b6970656469612f636f6d6d6f6e732f392f39302f526f6f66746f705f5061636b616765645f556e6974732e4a5047.jpeg%22%20alt%3D%2268747470733a2f2f75706c6f61642e77696b696d656469612e6f72672f77696b6970656469612f636f6d6d6f6e732f392f39302f526f6f66746f705f5061636b616765645f556e6974732e4a5047.jpeg%22%20%2F%3E%3C%2FSPAN%3E%3C%2FP%3E%0A%3CP%3EPredictive%20maintenance%20with%20Edge%20Impulse%2C%20Azure%20Sphere%2C%20IoT%20Central%2C%20Logic%20Apps%2C%20and%20Teams%3C%2FP%3E%3C%2FLINGO-TEASER%3E%3CLINGO-LABS%20id%3D%22lingo-labs-3268598%22%20slang%3D%22en-US%22%3E%3CLINGO-LABEL%3EAzure%20IoT%20Central%3C%2FLINGO-LABEL%3E%3CLINGO-LABEL%3EAzure%20Sphere%3C%2FLINGO-LABEL%3E%3CLINGO-LABEL%3EIoT%3C%2FLINGO-LABEL%3E%3CLINGO-LABEL%3EMicrosoft%20IoT%3C%2FLINGO-LABEL%3E%3CLINGO-LABEL%3ESecurity%3C%2FLINGO-LABEL%3E%3C%2FLINGO-LABS%3E%3CLINGO-SUB%20id%3D%22lingo-sub-3274090%22%20slang%3D%22en-US%22%3ERe%3A%20Build%20an%20AI-powered%20predictive%20maintenance%20solution%20with%20TinyML%2C%20Azure%20Sphere%2C%20and%20Microsoft%20Tea%3C%2FLINGO-SUB%3E%3CLINGO-BODY%20id%3D%22lingo-body-3274090%22%20slang%3D%22en-US%22%3E%3CP%3EThis%20is%20a%20great%20example%20of%20what%20is%20possible%20when%20you%20tie%20these%20technologies%20together.%26nbsp%3B%20Secure%20Predictive%20Maintenance%20should%20become%20the%20standard.%26nbsp%3B%20As%20the%20industry%20moves%20to%20embed%20more%20intelligence%20into%20devices%20on%20the%20edge%2C%20the%20risks%20associated%20cybersecurity%20increase%20exponentially.%20Organizations%20need%20to%20think%20beyond%20securing%20the%20network%20to%20securing%20the%20device%20itself.%26nbsp%3B%20%26nbsp%3BDaves%20article%20could%20represent%20a%20standard%20design%20pattern%20for%20secure%20intelligence%20on%20the%20edge.%3C%2FP%3E%3C%2FLINGO-BODY%3E
Co-Authors
Version history
Last update:
‎Mar 28 2022 08:50 AM