Image Processing or Video processing with OpenCV + Unity

[BartP0204]

Hello

I am a student from Belgium and I 'm doing my thesis with a hololens2.

I have to make an application on the hololens for bad sighted people.

To do that, I have used the free OpenCV package with Unity.

I need some help with the MRTK packages and how to use MRTK and OpenCV at the same time.

Is there an example program that already uses OpenCV with Unity for the Hololens2?

Many Thanx

Bart Punie

[#2]

I haven't done too much with OpenCV, but I've heard about this repository over here:
https://github.com/microsoft/HoloLensForCV
It's a little old, but I believe it used to be a go-to reference for a lot of people!

A bit of googling also brought me to this more recent resource, which seems to combine MRTK + OpenCV for Unity to make a "Minimal Setup". Haven't tried it either, but the premise looks pretty promising 🙂
https://github.com/abist-co-ltd/hololens-opencv-laserpointer

[#3]

Many thanks for the links and the info. It helped me get on my way! @koujaku 

[#4]

@BartP0204 

Hi, have you acheived to use OpenCVForUnity on Hololens 2 ? because i'm doing an internship and i have to do image processing on Hololens 2 and i need some filters from the OpenCVForUnity library. i imported the package on my project but ahen i deploy it on hololens 2 there is nothing displayed. if there is any help please tell mee.

Thanks !

[#5]

@fmtibaa You might find this GitHub link useful: https://github.com/EnoxSoftware/HoloLensWithOpenCVForUnityExample

However, I am struggling with it while using MRTK3 but I assume it works fine with MRTK2

[#6]

Hello@BartP0204 

It's great to hear that you're working on an application for visually impaired people using Hololens 2 and OpenCV with Unity. While I don't have an exact example program that combines OpenCV with MRTK specifically for the Hololens 2, I can provide you with some general guidance on using them together.

To integrate OpenCV with MRTK in Unity for Hololens 2, you can follow these steps:

1. Import the MRTK package into your Unity project.
2. Import the OpenCV package or plugin into your Unity project. You can find the OpenCV for Unity package on the Unity Asset Store or use a compatible plugin.
3. Set up your scene with the necessary MRTK components, such as the MRTK camera rig and input system.
4. Write your OpenCV code to perform image or video processing tasks. You can access camera feeds from the Hololens 2 through MRTK.
5. Combine the outputs of OpenCV with MRTK functionality to create your desired application features, such as object recognition, text extraction, or scene augmentation.

Remember to refer to the documentation and resources provided by the MRTK and OpenCV for Unity to understand their specific functionalities and how to integrate them effectively.

Best of luck with your thesis and the development of your application!

Find informations: howwmuch.net

[#7]

Thanks for the wonderful information it's a very useful post.
https://igtoolsnet.in/