HoloLens 1: Gestures not recognized in Unity 2019.4 with MRTK 2.8.3

Copper Contributor

I own an HoloLens 1 and so far I have developed some AR projects with Unity 2018.4.23f1 using the HoloToolkit (the version available in 2018). Now I want to develop a new project for HoloLens 1 with Unity 2019.440f1 LTS and use MRTK 2.8. I also use Visual Studio 2017.
I created a new project and followed Microsoft's instructions on how to install and configure MRTK 2.8.3 (for example, I followed Microsoft manual "Set up a mixed reality project in Unity with the Mixed Reality Toolkit"). I added the MixedRealityToolkit to the new scene I created. For the MRTK Profile configuration, I selected the DefaultHololens1ConfigurationProfile. In the Input section, I activated the InputSystem and selected the DefaultHoloLens1InputSystemProfile.
To verify that everything was correctly configured, I added to the scene a 3D cube, and, following Microsoft suggestions, I added the ObjectManipulator and NearInteractionGrabbable components to the cube. When I connect the HoloLens 1 to Unity through Holographic, I correctly see in the Hololens 1 the cube in the scene. Also, if I move the pointer over the cube, it correctly detects the presence of the cube. However, no gestures are recognized and therefore I cannot have any type of interaction with the cube. Even adding a bounding box with handles doesn't change the situation. The handles are recognized (their icons change) by the pointer, but then gestures are not identified and the presence of my hands in the FOV is not detected.
I tried creating a new project several times starting from scratch, changing profiles and configurations, but the result is always the same. Is there something I'm doing wrong or missing?
thank you for your help

5 Replies

@sergiocicconiunitnit I am also having same issue, any solution so far?

Hi, the only solution i found was to use legacy XR, new XR plugin cause gestures dont work so i uninstall from package manager all XR plugin managment.
It sounds like you’ve set everything up correctly, but gestures aren’t being recognized. Ensure that the Input System is properly configured and active in the MRTK settings, and check that hand tracking is enabled. Verify that the MRTK version you’re using is compatible with both HoloLens 1 and Unity 2019.4.0f1. Additionally, review your build settings to confirm they are correctly set for HoloLens 1 and UWP. If issues persist, consulting the MRTK documentation or forums may provide further solutions.
https://cupycutapk.com/

To troubleshoot gesture recognition issues with MRTK 2.8.3 in Unity 2019.4 for HoloLens 1:

  1. Check MRTK Profiles: Verify that the DefaultHoloLens1InputSystemProfile is correctly applied.
  2. Update Software: Ensure you're using compatible versions of MRTK and Unity.
  3. Verify Input System: Confirm the Input System is active and configured for HoloLens 1.
  4. Check Gesture Settings: Make sure the desired gestures are enabled in the Input System Profile.
  5. Rebuild and Redeploy: Rebuild your project and redeploy it to HoloLens 1.
  6. Test Samples: Try running MRTK sample projects to see if gestures work there.

If issues persist, consult the MRTK documentation or Microsoft Mixed Reality forums for further help.

@sergiocicconiunitnit

It sounds like you've followed the setup process for MRTK and HoloLens correctly, but you're encountering issues with gesture recognition and interaction. Here are some troubleshooting steps you can try:

  1. Check MRTK Input Settings: Ensure that the input settings are correctly configured in the MRTK profile. Verify that the correct input handlers and gestures are enabled.

  2. Update Unity and MRTK: Make sure you're using compatible versions of Unity and MRTK. Sometimes updating to the latest versions can resolve issues.

  3. Reimport MRTK and Dependencies: Try reimporting the MRTK package and its dependencies to ensure that no files are missing or corrupted.

  4. Verify HoloLens Input System: Double-check that the HoloLens Input System is properly configured in your Unity project. Go to Mixed Reality Toolkit > Utilities > Configure to ensure everything is set up correctly.

  5. Test with Sample Scenes: Use sample scenes provided by MRTK to determine if the issue is specific to your project or a general problem with the setup.

  6. Check HoloLens Updates: Make sure your HoloLens device is running the latest OS updates, as outdated firmware can sometimes cause issues with gesture recognition.

  7. Review Logs and Console: Check the Unity console and HoloLens logs for any errors or warnings that might provide clues about what's going wrong.

  8. Ensure Proper Gesture Recognition: Confirm that the gestures you're trying to use are supported and configured in the MRTK settings.

For video-related tasks, you might also find tools on  cupycut.

@sergiocicconiunitnit