hand tracking HTC VIVE Focus 3 Gesture Capture Issue in Streamed Unity VR with WaveXR SDK 5.6.0

[Snake Konginchrist]

Why can't my HTC VIVE Focus 3 capture gestures using the PC VR program (Unity) running through VIVE Business Streaming? I developed it using the waveXR SDK 5.6.0.

[VIVE_chengnay]

Hi @Snake Konginchrist,

May I know what's your goal?

To developer PCVR or AIO app?

[Snake Konginchrist]

I want to develop a PCVR app. Just run the Unity 3D project on my computer, and stream to my HTC VIVE Focus 3 by Vive Business Streaming.

[VIVE_chengnay]

Which type of gesture you would like to get and for what purpose?

[Snake Konginchrist]

Any gesture. Even the samples provided by official did not work properly.

So is it that my device does not support it, or is there a problem with my configuration somewhere?

[VIVE_chengnay]

For developing PCVR, you will need to use VIVE OpenXR Plugin.

Currently, VBS only supports OpenXR XR_EXT_hand_tracking.

For pinch and fist gestures will be mapping to controller's trigger and grip button.

For other gestures, you can follow the methods in below script,

https://github.com/ViveSoftware/VRS-Studio/blob/main/VRS_Studio/Assets/Scripts/ScissorsPaperRock/ScissorsPaperRock.cs

[Snake Konginchrist]

So VBS does not support hand tracking developed by Wave SDK?" To be able to use streaming to run gesture recognition, can I only use OpenXR?

[Snake Konginchrist]

For AIO VR Apps, can both Wave and OpenXR's hand tracking be used?

[VIVE_chengnay]

For developing AIO VR apps, you can use VIVE OpenXR Plugin too.

For gestures, you can follow below tutorials to create your own custom gestures.

https://developer.vive.com/resources/openxr/unity/tutorials/customhandgesture/

[Snake Konginchrist]

Hello, I've found that when developing hand tracking features on PC, neither Vive OpenXR nor Wave can achieve this through wireless or wired streaming. Instead, it seems I must build an Android package and install it on a VR all-in-one device to make it work. Is hand tracking functionality limited to the Android native environment? When will it support hand tracking in a streaming environment?