When I joined the Mixed Reality (MR) community a little over a year ago, I hoped that we'd eventually get to a point where getting started in XR could be more approachable for people who were looking for a low code/no code route. There's a pretty steep barrier to entry for getting started with creating MR apps and experiences. For me, I had to learn a new programming language and game engine. I also needed access to the proper hardware. However, my hope was that this would all change (or at least get better) for future MR developers.
But why?
Well, I strongly feel that there's so much untapped potential just waiting to be discovered (or even uncovered) in the MR space. Every so often, I meet someone who's interested in getting started with MR but don't necessarily have access to all the 'required' tools. I often found myself suggesting that they'd build their app/experience then try in an emulator of some sort. However, testing on a computer in no way compares to actually testing on an MR device.
Well, I've finally found a solution -- or at least an option for folks who have access to a mobile device or tablet. Aside from a computer with an internet connection, there's no additional hardware required. There's also no need for a game engine or code editor. With that said, you could get started as soon as you're done with this post. As for the solution, drum roll please….
Power Apps! Yes, you can create an MR app with Power Apps! Power App is a low code/no code platform for creating apps. The Maker portal is a drag and drop platform that's great for creating apps without getting code involved. Of course, if you'd prefer to do some coding within PowerApps, there's always the option to do that as well.
Just last year, the Power Apps team announced new MR components that are available for use in your Power Apps apps! The components include the following:
- View in 3D - Rotate and zoom into the model with simple gestures. Display a single model or let the user select from a gallery of 3D models.
- View in Mixed Reality - See how a particular item might fit within a specified space. Overlays a 3D model or image onto the live camera feed of the device.
- Measure in Mixed Reality - Measure distance, area, and volume. A 2D or 3D polygon is created to confirm how a certain sized object would fit within a space.
All 3D models used within Power Apps must be in .glb format. You could also include 2D images (.jpg or. png). Since I don't have a personal arsenal of 3D objects, I thought I'd find it difficult to find 3D models to use. Fortunately, we provide an open-source library of 3D models. If you happen to be running on Windows, you could also use Microsoft 3D Builder.
If you've never used Power Apps before, my best recommendation is to first work through the Power Platform learning path on Microsoft Learn. This learning path provides quite a thorough introduction to Power Apps. If you happen to already be familiar with creating apps in Power Apps, then dive right in to the Mixed Reality Power Apps components documentation.
If you're in search of detailed instruction or a sample app that uses some of the components together, check out my YouTube tutorial on how I created a sample interior decorating app.
Here is a list of resources to get you started:
Power Apps
•Microsoft Learn: aka.ms/learn-powerplatform
•Microsoft Docs: aka.ms/docs-powerapps
•Mixed Reality Power Apps Components: aka.ms/powerapps-mr
•Connectors: aka.ms/connectors
3D Models
•GitHub: aka.ms/models
•Unity Asset Store: assetstore.unity.com
Video Tutorial
•YouTube: aka.ms/mr-powerapps
I'm always in search of new use cases for these features. Please comment below how you plan to use these features!