Business Streaming Hand Tracking in UE4

[danwrong]

Hi all,

I'm really eager to get hand tracking data through to UE4.27 from Focus 3 via the new business streaming update but I'm having some challenges.  I've got the latest client and server VBS software and have enabled hand tracking in the VBS settings.  It seems to be working to some degree as the vive home area renders controllers at my wrist positions. 

However, if I try to get access to finger data in UE4 either via OpenXR (GetMotionControllerData) or via Steam Input (GetSkeletalTransform) I get no finger data.  As far as I can tell it thinks my hands are controllers.

Does anyone have any tips?

Thanks!

 

[Frankfurt]

Hey danwrong! Have you figured this out? I'm having the exact same issue/question! Thx

[danwrong]

No, not yet.  Would love some input from the product team if possible.  I'll put a sample project together and post shortly.

[C.T.]

@danwrong @Frankfurt here's a sample UE build shared from our internal team, can you give it a try? 
I'd also like to know have you installed other vive runtime on your PC by any chance? 

OpenXR426_Unreal_OpenXRHandTestApp.7z

[Frankfurt]

@C.T. That's great! Thank you very much (and the "team") in advance. Will test this quite soon and will report. 

[danwrong]

Well do, thanks @C.T.

[danwrong]

Hi @C.T.

Just tried this and the app loads successfully but I don't see tracked hands.  I'm using Focus 3 connected wirelessly via the latest Vive Business Streaming app with Hand Tracking enabled.  If it helps, I don't see tracked hands in the vive home screen either, I just see controller models tracked to my wrists.  It looks like the data is there but steamVR isn't recognising hands.  Thanks so much for working with the team on this, we're very eager to get this working in our project.

Thanks,

Dan

[C.T.]

@danwrongfew things I would suggest to try first is to keep everything up to date, such as Focus 3 firmware 3.0.999.418, VBS client 1.0.9.46 updated via VBAS , VBS console 1.7.6a on desktop.

but seems you did not see hand tracking under vive home, I supposed you meant the environment inside Focus3? You will need to enable that first inside setting -> connectivity. 

let me know if that helped or I can check if there's anything else you were missing here

[danwrong]

@C.T. All my software versions are up to date.

Apologies, though, I was unclear on the other part.  Hand tracking is working in the focus environment and is enabled in VBS.  In the steamVR home environment once I'm streaming from steamVR via VBS I can see my wrist positions represented as controller models but in the example app I see no hands at all.  Thanks!

[C.T.]

okay, so under SteamVR you need to alter your hand model to five fingered hand one to make it work. 
And just to make sure we are on the same page, is your VBS client in Focus 3 now 1.0.9.46?