Eye Tracking data while playing SteamVR Game

[FabianS]

Hey,

I'm currently taking on the task of having test subjects play the game Half Life Alyx and record their movements at the same time. This includes the movements of the head, the hands and also the eyes. My approach was originally to write a Python script that records this data. This worked well until I started to integrate the eye tracking into this script. Here I did not find a working possibility.
Therefore my first question. Is there a way to retrieve the data about the eyes via Python? If this is not possible, I would like to come to my second question.

My next approach was via Unity, as I have already read a lot about the possibility of recording eye tracking via Unity. However, I have not seen any post about recording with Unity where a person is playing a SteamVR game at the same time. For me it was not possible to use SteamVR in Unity to record the motion data and run SteamVR in parallel via Steam to play the game.
And this is where my second question comes in. Is it possible to run two SteamVR instances, or is it possible to record motion and position data from the HMD, the controllers and the eyes via Unity while running an external SteamVR instance?

Generally, I would prefer if this could be done via Python script, but any help is appreciated.

 

[FabianS]

One thing I forgot to mention is that I am using the VIVE Pro Eye 2 for this task.

 

On 10/20/2021 at 11:52 AM, FabianS said:

Hey,

I'm currently taking on the task of having test subjects play the game Half Life Alyx and record their movements at the same time. This includes the movements of the head, the hands and also the eyes. My approach was originally to write a Python script that records this data. This worked well until I started to integrate the eye tracking into this script. Here I did not find a working possibility.
Therefore my first question. Is there a way to retrieve the data about the eyes via Python? If this is not possible, I would like to come to my second question.

My next approach was via Unity, as I have already read a lot about the possibility of recording eye tracking via Unity. However, I have not seen any post about recording with Unity where a person is playing a SteamVR game at the same time. For me it was not possible to use SteamVR in Unity to record the motion data and run SteamVR in parallel via Steam to play the game.
And this is where my second question comes in. Is it possible to run two SteamVR instances, or is it possible to record motion and position data from the HMD, the controllers and the eyes via Unity while running an external SteamVR instance?

Generally, I would prefer if this could be done via Python script, but any help is appreciated.

 

 

[JensN]

Hello

I know this is an old post, but did you ever figure out a solution? A user of our lab has a similar problem.

 

BR

Jens