We annonced , in September 2018, new 1st party Mixed Reality business applications from Microsoft:
We recognize that many employees need information in context to apply their knowledge and craft. Not only on a 2-D screen — but information and data in context, at the right place, and at the right time, so employees can produce even greater impact for their organizations. Mixed reality is a technology uniquely suited to do exactly that.
Here is Dynamics 365 Remote Assist ⬇
Let's explicit how you can leverage on Remote Assist calls directly within you HoloLens Mixed Reality apps!
Step 1. The Unity project has to be set up for Windows Mixed Reality
Note: You can skip this part if you are familiar with Unity and Mixed Reality.
As usual, you should have an Unity project configured for Windows Mixed Reality:
File menu / Build Settings ➡ Universal Windows Platform selected as the Build platform
Edit menu / Project Settings / Player ➡ Virtual Reality Supported checked
Edit menu / Project Settings / Player ➡ Other Settings / .NET as Scripting Backend. Please also use the Experimental (.NET 4.6 Equivalent) for the Scripting Runtime Version.
Step 2. Call the Remote Assist protocol from the Unity App
As you know, in a Mixed Reality Application, we can call UWP APIs. We just have to decorate the calls with a Platform dependent compilation directive:
// Blablabla in C# for UWP
Click on the user whom you want to call by using Remote Assist
The page displays the Objet ID of the user
For testing, you just have to use it directly in your code in the url for the LaunchUriAsync call.
string uriToLaunch = @"ms-voip-video:?contactids=bf538576-xxxx-yyyy-zzzz-1d548b9e7010";
Do not worry if you are not able to perform this step; Remote Assist is smart enough to propose you an user interface to choose the person to call if you launch it with an object ID that does not exist.
Step 4. Test the code
To test the code, we have to run the code on the HoloLens device; It is because we use UWP APIs and we have to launch the Remote Assist app which is only on the HoloLens device.
Here are the steps to deploy the app on the HoloLens with Visual Studio:
Build the Unity project (You choose a folder in which Unity generates a Visual Studio solution ; Usually, we create a new subfolder of the Unity project named App ).
Open the resulting Visual Studio solution and choose x86 on Device (if USB connected) or Remote Machine (if the PC and HoloLens are on the same Wifi).
To get the IP address of your HoloLens, take a look at this video
Debug or Start without debugging in Visual Studio: The apps will be deployed and launch on HoloLens.
Note: You can also Deploy the app on the HoloLens by using the Build menu / Deploy Solution . Then, on the device, just locate and launch the app from the Start menu.
How does the app work ?
In your app, you run the LaunchUriAsync method with the Remote Assist protocol. This protocol is registered for the Remote Assist app and Windows opens the app.
The Remote Assist App has the Object ID of the person to call in the url and initiate the call immediately to this person (if the object ID is not found, Remote Assist allows the user to select a person to call).
The user can then switch back to the HoloLens App using the Bloom gesture and by finding the app in the Start menu.
Your HoloLens app runs and Remote Assist continues streaming the video/audio to the remote user.
Do not forget to get back to the Remote Assist app when finished in order to stop the call.
A more interesting sample with a tagalong billboard following the user gaze
The entire source code is available on GitHub . The sample provide you a Holographic button that is always
Following you (the camera).
Oriented in front of you.
At a fixed distance from you.
Visible and not directly in the center of the field of view: it seeks to have a part of itself in the view frustum of the camera
The purpose of this sample is to provide you an out of the box tagalong billboard for you apps!
Here is below, in action, this sample and the Remote Assist call done.