Microsoft Technology Centers has partnered with Kagool to demonstrate an end-to end field service management solution combining Azure Percept DK, AI, IoT, Cognitive Services and Mixed Reality with a physical Lego model.
Using Azure Digital twins, Mixed Reality and Azure Percept DK we digitalized the physical Lego Excavator into a digital presence, combining real-time telemetries and integrating a full end-to-end field service management solution. Real-time performance monitoring can be analyzed globally from a central location allowing you to reduce downtime and the cost of maintenance, optimize performance, reduce TCO and extend the life of your assets. Trend analysis enables intelligent servicing and predictive maintenance, allowing you to take preventative action before failures occur.
In this article our focus is to demonstrate how you can use the Azure Percept DK to integrate an end-to-end field service management solution and overlay the telemetries on a Digital Twin using Mixed Reality.
The architecture diagram below covers all the services we have used for implementing the field service management solution. The data which is being gathered by Azure Percept DK is being sent to IoT Hub where the Azure function is being triggered automatically (Event grid) to update the properties in Azure Digital Twins (ADT). In ADT, we rebuilt the global Lego asset deployments in a digital replica showing you exactly where each asset is deployed. Unity (Game Engine) will retrieve the properties based on custom queries sent to ADT using REST APIs and overlay telemetries on a 3D model.
Below is a video on how the digital twin responds to the real-time Azure IoT ingested telemetries (as viewed from HoloLens 2 device):
For you to get started, you will need to complete some prerequisites. You will need to set up your Azure Percept DK, create and configure an IoT Hub resource, train an AI model using Custom vision and lastly, set up your Function app instance to be able to move the data between services. If you need any help getting started, please look at the following resources:
We have demonstrated to you how easy it is to integrate the Azure Percept DK with HoloLens. With this field service management solution, you can easily monitor your assets remotely from anywhere around the world and predict if a part is about to become defective to prevent any potential downtime or loss. This solution can be implemented in situations where humans cannot physically reach the asset location, or it would be a real danger for them to do so.
The benefits of this solution are many, we outline just a few below:
Purchase Azure Percept DK
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.