Capturing User Facial Expressions with Eye and Facial Trackers in Unity for Avatar Animation

[Chloe Chen]

Hello everyone,

I hope you are all doing well. I've been working on a project that involves using eye trackers, facial trackers, and Unity to capture users' facial expressions. I have successfully collected this data and now I'm wondering if it's possible to project this data onto an avatar to create a dynamic video that replicates the user's facial expressions on the avatar.

Here are the details of the tools and software versions I have used:

- Unity: 2021.3.20.f1
- VIVE OpenXR Plugin - Windows: 1.0.13
- UniVRM: v0.113.0

I would greatly appreciate any guidance or advice on how to achieve this. Thank you in advance for your assistance!