Forum Discussion

Copper Contributor

Jul 12, 2021

HELP: Hololens2 apply camera capture texture for Spatial Mesh

I successfully saved and displayed the spatial mesh after scene understanding room scanning process. Now I am struggling about how to apply hololens camera live texture to mesh. Any Solution?

Icon for Microsoft rank

Microsoft

Jul 12, 2021

Just FYI, this is a pretty tricky problem to solve! I've seen it done, but it may require a fair bit of work.

If you're interested, there was a brief discussion on this topic a while ago that does go into a few details:
https://techcommunity.microsoft.com/t5/mixed-reality-feedback-and-help/texturing-spatial-mesh/m-p/2149245

It's also quite helpful for us to know what you're hoping to achieve with this as well. Can you tell us anything about your use-case?

senthilvelGS
Copper Contributor
Jul 14, 2021
Thank you for your reply. My use case is display the current Room with real color texture at runtime in front of the hololens camera. It is like a 3D minimap. I am using unity3d(2019.4.23 version) with c#. I have imported the scene understanding plugin for Room scanning. Room scanning and displayed the room mesh functionalities are completed. Now I want apply the real world room texture to the displayed mesh.
I have attached my sample output.
- daniel_camara
  Copper Contributor
  Aug 13, 2021
  Hi I am interested in the same thing :), I also just managed to get the scene on .obj and would like to have the texture from the camera over the object, even if in post processing it wouldn't be a problem for me. Did you manage to advance over this problem?
  
  By the way, I guess the code used on the paper mentioned on the other post can be found at https://github.com/samueldong-us/Realtime-Hololens-Retexturing.