Microsoft committed to HoloLens 2 and Mixed Reality
Published Feb 02 2023 11:53 AM 52K Views
Microsoft

HoloLens2-Front-line-worker.jpg

 

On behalf of the Mixed Reality team at Microsoft, I wanted to share some important context and insights on the Mixed Reality program at Microsoft. The intent of this note is to help provide clarity to this community on our commitment to HoloLens 2 and the broader Mixed Reality program.

 

We continue to produce and support HoloLens 2, inclusive of monthly software updates to ensure our enterprise customers can leverage HoloLens 2 and the supporting platform to complete critical work. We also continue to update Dynamics 365 Guides and Remote Assist to address the needs of those customers. HoloLens and Dynamics 365 are key components of Industrial Metaverse deployments, connecting the benefits of digital transformation to frontline workers in field service, factory operations, and many other use cases. For more information, see our recent blog post highlighting some of the progress on the HoloLens platform and how customers are seeing real-world benefits.

 

In the case of the Mixed Reality Toolkit (MRTK), we are proud of how this project has accelerated cross-platform mixed reality app development for so many developers over the years. From its inception, we created the MRTK to be cross-platform and open-source to benefit the entire ecosystem and not just HoloLens. We are excited that the open-source approach will enable it to live on, and we hope to see increased contributions from others across the Mixed Reality space. Additionally, Microsoft is committed to maintaining compatibility between MRTK and HoloLens 2, including through continued open-source contributions to MRTK when needed to ensure developers using MRTK can continue to build for and deploy to HoloLens 2. 

 

We are also investing in richer and more immersive collaboration experiences in the metaverse with Microsoft Mesh. We are currently in preview with enterprise early adopters who are providing feedback as we iterate on experiences and offerings. Earlier this month, the World Economic Forum invited global leaders in Davos to experience its Global Collaboration Village, built on Microsoft Mesh with the help of Accenture. And while we’ve made the difficult decision to sunset AltspaceVR, what we’ve learned has helped set a foundation for our shift to Microsoft Mesh, to become a platform that offers the widest opportunity to all involved, including creators, partners, and customers.

 

Lastly, there is important and exciting work we are doing to support the Integrated Visual Augmentation System (IVAS) program. We recently contracted with the U.S. Army to revise the IVAS product design to address soldier feedback, a testament to our partnership with the government, commitment to the program, and ability to rapidly iterate on product designs to achieve results. IVAS is a great example of technology sharing between commercial products and fit-for-purpose government programs. While HoloLens and IVAS are very different devices, they both build on Microsoft’s long history of developing best-in-class Mixed Reality technologies.

 

We look forward to sharing additional updates in the future while continuing ongoing collaboration with our customers, partners, and developers to innovate in this critical space. 

 

15 Comments
Copper Contributor

Do you know if Microsoft will continue to develop Xamarin.iOS which allows C#/.NET developers to write code-first Augmented Reality experiences in Visual Studio that can be deployed onto over 2 billion iPhones?

or StereoKit which allows C#/.NET developers to write code-first Virtual Reality experiences in Visual Studio that can be deployed onto Meta Quest headsets?

I'd love Microsoft's limited Mixed Reality strategy grow beyond just HoloLens and also promote the aforementioned ability to target these other popular devices using Microsoft technology to create immersive experiences for millions of people.

Copper Contributor

@LeeEnglestone for cross-platform XR applications you could consider 3rd party solutions. For visual positioning of AR content / spatial anchors check Immersal SDK. They support iOS and Android, and most AR glasses including Hololens. Take a look at https://immersal.com/ and their Developer portal. 

Great questions @LeeEnglestone and easy to respond to.

 

Xamarin is maintained by the visual studio team and as far as I'm aware is unaffected by the recent restructure. That platform is constantly evolving and now supports Maui as well.

 

As for StereoKit, this isn't a Microsoft product and was developed in open source by Nick Klingensmith and you can check his status and that of StereoKit on LinkedIn here.

https://www.linkedin.com/in/nickklingensmith

 

Hopes that helps

Copper Contributor

Could we get a statement about Azure Spatial Anchors? This project had few releases in 2022 and engagement from Microsoft seems to have paused with the beginning of 2023?

 

https://github.com/Azure/azure-spatial-anchors-samples

Copper Contributor

Thanks @Simon Jackson - I have no doubt about the commitment and passion of the XR community.


What would be good would be an official utterance / overarching holistic Consumer + Enterprise Mixed Reality strategy from Microsoft that encompasses not just HoloLens/Enterprise but also Consumer, Cross Platform (Xamarin.iOS to target ARKit, Xamarin.Android to target ARCore), Open Source (eg. StereoKit), Unity/ARFoundation and of course MRTK.

Their entire Mixed Reality strategy (outside looking in) seems to be Enterprise/HoloLens which is allowing competitors to scoop up everything else which will then come for the enterprise as well. This is what happened to Blackberry. Too much focus on Enterprise, underestimated the threat of consumer options that could be used for both consumer & enterprise. 

 

I've met 100's of .NET developers that don't realise that they can use code first .NET/C# to create Augmented Reality experiences for iPhone using Xamarin.iOS.

 

HoloLens aside, Microsoft have vast potential to be relevant on billions of XR ready devices (iPhones, Androids, Meta headsets) today! and a major player in the consumer AR/VR market using the Microsoft technologies I mentioned already available to .NET developers, but they choose not to promote them?

 

A little investment in promoting their multiple options for XR development that are available to millions of .NET developers would benefit Microsoft greatly.

@FrankLanganke Azure Spatial Anchors is managed by the Azure teams as far as I'm aware and was not affected by the recent restructure and it was updated to the latest release about 6 months ago, as it's scope is purely for azure and it supports multiple platforms natively I see no issue with its future. You can check its status here:
Azure/azure-spatial-anchors-samples: Azure Spatial Anchors sample code (github.com)

 

You can also reach out to the team through the github site, or log a support request through the Azure portal for more details.

 

But here's hoping the areas surrounding the MRTK and augmented reality continue in 2023 and beyond.

Copper Contributor

Didn’t Microsoft lay off the entire MRTK team?  Why would I continue to invest in Microsoft’s vision for mixed reality as opposed to another framework that still has a team behind it?

Copper Contributor

Strong supporter of your post, @Robin Seiler! Microsoft HoloLens has been a biggest motivation for our existence. We showcased Teleportation Demo in XR metaverse at an MIT Conference 5 years ago - https://youtu.be/M05UHiibR2Y

 

Looking forward to continue to support our DIY Metaverse Software, Atom for HoloLens. It is like Mesh, with full body realistic avatars, ChatGPT enabled and is powered by Microsoft Azure! Early access is available on imaginate.in 

 

 

Copper Contributor

I would really like to get some clarity about ongoing optimizations to the Edge browser on HoloLens 2. Most of the WebXR examples for Babylon.JS and AFrame on learn.Microsoft.com have sub-30fps performance on HoloLens 2, even lower performance than Oculus Go. Stand-out WebXR games like MoonRider.xyz and Mozilla Hubs also perform significantly more poorly on HoloLens 2 than any other mobile XR device I’ve tested. Based on the amount of compute in the HoloLens 2 SoC, it should be able to get better performance, but it looks like even the Edge JIT compiler isn’t effectively tuned for the CPU cache. I love the promise of HoloLens as a unique point of view in the XR market and as leading the charge on open platforms. That said, For me to keep optimizing and testing my startup’s WebXR app on the device, and selling into the HoloLens enterprise and military user base, I need something more concrete than the statements above.

Copper Contributor

Related to XR: Might Azure Remote Rendering make an appearance inside of Microsoft Guides in the future? 

Those two products seem like they could go hand-in-hand.

Copper Contributor

Excused me. I would like to ask about the Microsoft Mesh App. I recently tried to login and it shows "failed to login to server" message. I would like to know the situtation since it is a great app for hololens. I would like to know when can I use it again?

Copper Contributor

Hi, i am working on my master's thesis about HoloLens 1 gen and i want to create application in unity to take measurements about real object, but for a last month i can turn on any application on HoloLens gen1 created on Unity? Is this still supported and possible? and if yes, do you have any current tutorial for it?

Interesting point @Siekla19 , the most likely path to do a build for HoloLens 1 would require you to use the original "HoloToolkit" (precursor to the Mixed Reality Toolkit)
Release HoloToolkit 2017.4.3.0 - Refresh · microsoft/MixedRealityToolkit-Unity (github.com)

(above is the final release for the HoloToolkit)

 

You will also need to use the latest Unity 2017 LTS build (newer versions "might" still work, but not sure).

As well as Visual Studio 2017 and the Windows SDK 10.0.17134

 

It has been a while since I tried deploying to my HL 1, but the above should work best.  Early versions of the MRTK2 did still support HoloLens 1, but I'm not sure about its state in the finished MRTK2 releases.

 

Good luck and let us know how you get on and feel free to reach out on the HoloDevelopers slack channel for further questions.

Brass Contributor

It appears that I predicted the future about Microsoft adding Azure Remote Rendering into Guides!!!  This message appears in the Release Wave 2 for Guides: 

"Guides will be adding Azure Remote Rendering to the application, which makes it significantly easier to use any 3D assets on HoloLens 2."

Yay!! 

 

Unfortunately "adding text labels to a guide" seems to have not been implemented yet from the Release Wave 1 and is not mentioned in Release Wave 2, although I have been needing this feature for some time (due to the Step Card only allowing 8 lines of text.....)

 

I am super happy to hear that Azure Remote Rendering will be coming into Guides! 

Copper Contributor

does HoloLens work with O365 apps?   I am accountant and would like to be able to work via virtual monitors.

Co-Authors
Version history
Last update:
‎Feb 02 2023 02:39 PM
Updated by: