Can not use eye tracking in hololens2

Question

question

99551921 asked Feb 12, '22 Djangi answered Apr 19, '22

Can not use eye tracking in hololens2

Recently, I suffered a very confusing problem that I can not use eye tracking in hololens2 after i deploy the eye tracking default example given by Microsoft. The details are below.

My versions:
unity 2020.3.25
MRTK 2.73

I followed and finished the tutorial named "Eye tracking examples overview" and its link:
https://docs.microsoft.com/en-us/windows/mixed-reality/mrtk-unity/features/example-scenes/eye-tracking-examples-overview?view=mrtkunity-2021-05
But after i deploy the example into hololens2, there is a gaze cursor, but it can not follow my eyes, instead it seems to follow my head. And i can control the cursor to locate at the planer with four scenes: "target selecting", "navigating", "TargetPosition" and "visualizer" and use my hand pinch to select "target selecting". Though it works, when i make the cursor on one of the targets(gemstones), the target can not rotate. Above things mean that all functions work except eye tracking.

In addition, when deploying successfully, there is a window writing "eye calibration rocks". I try to flip the visor up and down, but the calibration can not happen. If i try to return to "setting" to calibrate and after calibration, the example scene disappears and i have to deploy it again. Finally, it becomes an infinite cycle...

By the way, the example of running in unity is fine.

How can i use eye tracking on hololens2? Where is my mistake?

hololens-development

· 7

5 |1600 characters needed characters left characters exceeded

Attachments: Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

HernandoRen-MSFT · Feb 14 at 07:11 AM

It is possible you have denied eye-tracking permission when starting the app on your HoloLens 2 for the first time. To use eye-tracking input, you can reset this in Settings → Privacy → Apps.

0 ·

99551921 HernandoRen-MSFT · Feb 14 at 11:56 AM

Thanks for your suggestion！ I have opened the permission, but it doesn't work, which means still can't use eye-tracking. Is there any other possible mistake that I have?

0 ·

99551921 HernandoRen-MSFT · Feb 14 at 01:33 PM

By the way, can I wear glasses to do eyes calibration?

0 ·

HernandoRen-MSFT 99551921 · Feb 15 at 07:27 AM

Of course, the eye-tracking system will not return any input if the user is not calibrated. You can find the eye calibration in the system settings: Settings > System > Calibration > Run eye calibration.

0 ·

99551921 HernandoRen-MSFT · Feb 16 at 11:40 AM

Thanks! I tried several times to open privacy and it was successfully! Thank you again!

0 ·

99551921 99551921 · Feb 20 at 06:02 AM

I am so sorry to tell you that I still can not use eye-tracking in hololens2. After finishing the way(Settings → Privacy → Apps), I found that I can use eye-tracking in holographic remoting, however, I fail to use eye-tracking in hololens2 when deploying the default eye-tracking example provided by MRTK, even though I have calibrated using this way(Settings > System > Calibration > Run eye calibration). The example I used, name "Eye-tracking examples overview" and its link:
https://docs.microsoft.com/en-us/windows/mixed-reality/mrtk-unity/features/example-scenes/eye-tracking-examples-overview?view=mrtkunity-2021-05
Pictures showing apps' privacy opened and eye calibration rocks are below:

0 ·

permission-opened.jpg (354.2 KiB)

eye-calibration-rocks.jpg (554.8 KiB)

99551921 99551921 · Feb 20 at 06:03 AM

I am so sorry to tell you that I still can not use eye-tracking in hololens2. After finishing the way(Settings → Privacy → Apps), I found that I can use eye-tracking in holographic remoting, however, I fail to use eye-tracking in hololens2 when deploying the default eye-tracking example provided by MRTK, even though I have calibrated using this way(Settings > System > Calibration > Run eye calibration). The example I used, name "Eye-tracking examples overview" and its link:
https://docs.microsoft.com/en-us/windows/mixed-reality/mrtk-unity/features/example-scenes/eye-tracking-examples-overview?view=mrtkunity-2021-05
Pictures showing apps' privacy opened and eye calibration rocks are below:

0 ·

Answer 1 · 2022-02-17T08:14:19.68Z

HernandoRen-MSFT answered Feb 17, '22 99551921 commented Feb 20, '22

Hello, Welcome to Microsoft Q&A,

The first thing we can check is the eye-tracking permission when starting the app on your HoloLens 2 for the first time. To use eye-tracking input, you can reset this in Settings → Privacy → Apps. Also, the eye-tracking system will not return any input if the user is not calibrated. You can find the eye calibration in the system settings: Settings > System > Calibration > Run eye calibration. For more information please see: Fallback when eye tracking isn't available

If the response is helpful, please click "Accept Answer" and upvote it.
Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.

5 |1600 characters needed characters left characters exceeded

Attachments: Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Answer 2 · 2022-04-19T08:41:18.91Z

Djangi answered Apr 19, '22

I just encountered a similar issue. Eye tracking works flawlessly when in I run my project in the Unity Editor(via Holographic Remoting) but doesn't do anything when I build and run on the HL2.
Luckily Joost van Schaik made a post about this on this on his blog: https://localjoost.github.io/Getting-Eye-Tracking-to-work-with-OpenXR-on-HoloLens-2/

In a nutshell, you don't only need set up your input profile for eye tracking, you also need to add an Eye Gaze Interaction Profile Porjects Settings -> XR Plug-in Management -> OpenXR -> Universal Windows Platform Settings tab -> Interaction Profiles

I hope this helps.

5 |1600 characters needed characters left characters exceeded

Attachments: Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

question