Vive Vision Focus Eye Tracking Capability Questions

[Garrett]

Hello! Our team is looking at solutions for using eye tracking in VR headsets and wanted to clarify some details around the eye tracking APIs for the Vive Focus Vision and Vive XR Elite (+ eye tracker add-on):

- Is it possible to read eye tracking data when running an application as embedded, streamed via wire, and streamed wirelessly? We have used headsets previously, for example, that support eye tracking only when running embedded experiences but not through wired or wireless desktop streaming. I've seen the API feature support table here (https://developer.vive.com/resources/getting-started-with-xr-elite/) but it does not make it clear if / how eye tracking data is available when operating the headset in a wireless streaming mode from a host desktop computer.

- Where can we see more detailed information around what kind of eye tracking data is accessible through the API and how to access it? I see the eye tracking data function for the Wave here (https://hub.vive.com/storage/docs/en-us/WVR_GetEyeTracking.html#_CPPv223WVR_CombinedEyeTracking) but only see data for facial expressions in the OpenXR docs (https://registry.khronos.org/OpenXR/specs/1.0/html/xrspec.html#XR_HTC_facial_tracking).

- What kind of error and precision metrics can we expect about where a user is gazing? Are there any? We'd like to use this for research applications and have information about the confidence and error bounds of a look direction if possible.

Thank you!

[VIVE_chengnay]

Hi @Garrett,

You can install VIVE OpenXR Plugin v2.4.2 which is the latest version for now.

https://github.com/ViveSoftware/VIVE-OpenXR

Please check out our tutorial guideline and we do have FacialTracking samples for reference.

https://developer-express.vive.com/resources/openxr/unity/tutorials/face-data/getting-data-of-facial-tracking/

For error and precision metrics, I will check internally and get back to you later.

 

[Garrett]

Hi @VIVE_chengnay - I appreciate the links but this doesn't answer my questions. From my original post:

Quote

Is it possible to read eye tracking data when running an application as embedded, streamed via wire, and streamed wirelessly? ... it does not make it clear if / how eye tracking data is available when operating the headset in a wireless streaming mode from a host desktop computer.

I would specifically like to know if eye tracking data when Focus Vision Pro is used in a wireless PC streaming mode. In my experience most headsets do not fully support this usage. The documentation you've linked also does not clarify this.

 

15 hours ago, VIVE_chengnay said:

Please check out our tutorial guideline and we do have FacialTracking samples for reference.

I'm not interested in tracking facial expressions. Per my original post we are interested in using eye tracking data for research applications and want access to detailed eye tracking information including look direction per-eye, pupil dilation, error bounds, IPD, precision, etc in real time. Where can I find the list of raw data that is provided through the API?

 

15 hours ago, VIVE_chengnay said:

For error and precision metrics, I will check internally and get back to you later.

That would be great, thank you -

[VIVE_chengnay]

Hi @Garrett,

Is this page good for you?

https://developer.vive.com/resources/openxr/unity/tutorials/face-data/getting-the-data-of-eye-tracker/

If there is any missing information, please let me know.

UPDATE: We provided 3 APIs, GetEyeGazeData, GetEyePupilData and GetEyeGeometricData.

[VIVE_chengnay]

Hi @Garrett,

Please use the latest VIVE OpenXR Plugin v2.4.2 for eye tracking data.

And, you will need to switch VIVE Hub to Beta and update VBS client app.

[Garrett]

Quote

UPDATE: We provided 3 APIs, GetEyeGazeData, GetEyePupilData and GetEyeGeometricData.

Thank you for the API details. It would be good to know if there are any static or query-able confidence / error metrics for this data, as well.

Quote

Please use the latest VIVE OpenXR Plugin v2.4.2 for eye tracking data.
And, you will need to switch VIVE Hub to Beta and update VBS client app.

To be completely clear - our team have not yet purchased any Vive headsets. We are trying to understand the capabilities of the Focus Vision headset so we can determine whether it's capabilities are suitable for our needs before making a purchase.

It's not clear to me what a "beta" version of the plugin might offer and whether this will enable support eye tracking while streaming data wirelessly from a desktop computer.

Edited November 6, 2024 by Garrett

[VIVE_chengnay]

Hi @Garrett,

"Beta" is just a process before we release to public version.

For the time being, you need to enable "Beta" in VIVE Hub and use VIVE OpenXR Plugin v2.4.2 for eye tracker data.

Yes, we do support streaming(wired/wireless).