VIVE XR Elite - Tracking QR Code/AprilTags

[RMFoley92]

Hi all,

I'm working on a commercial project at the moment looking to put a 'digital skin' onto training manikins for use in emergency response training utilising Passthrough. The idea is that the trainee is in their own environment and when they look at the manikin it has a digital skin overlayed. Our thought is that we will track the position of a manikin and it's arms/legs using either QR Codes or AprilTags.

We're around 6 months into the project and initially started development on the Quest Pro as it was the only affordable headset on the market that offered colour Passthrough, however we found both the hardware and Meta's support too restrictive to allow us to achieve what we want.

On looking for a solution we spoke to HTC about the capability of the new XR Elite headset and were assured that the headset has the capability to track QR Codes/AprilTags with Passthorugh. Using Unity, we've successfully managed to produce a project with a working Passthrough underlay, however we're struggling to see a solution to allow us to track images/qr/apriltags using Passthrough.

Is there an SDK or Plugin we can utilise to achieve this functionality? If not what options do we have to achieve the functionality we want?

[Tony PH Lin]

Hi,

Current there is no public SDK/plugin to provide camera raw image data for you to proceed such kind of applications. 

We're considering this kind of enterprise application use case, and there might be further opportunity to have this functionality. 

Could you contact our region sales team to bring the request for further cooperation?

Thanks.

[RMFoley92]

Hi Tony,

Thank you for getting back to me.

We're currently in the process of engaging with the developer programme via our regional team in the UK to explore the use of this functionality with the headset; as well as gauge the feasibility of using the new physical trackers you've developed.

I'll be sure to reach out if we require any more assistance, we're keen to work together with HTC to develop our vision as we feel it will be a first of it's kind application of this sort of technology

Thanks,