Jump to content

Hand tracking test 0.91 Vive Cosmos


davide445

Recommended Posts

  • Replies 35
  • Created
  • Last Reply

Top Posters In This Topic

11 hours ago, davide445 said:

@VibrantNebula

looking at other options the only I can find are Occipital Structure, Intel RealSense and Orbbec Astra Mini, all with Gestoos sw for gesture recognition. 

Any experiences with one of them? 

PS also can anyone check if a 13x80mm (0.5x3.2 inch) object (the Leap Motion sensor) can fit horizontally into the Cosmos without occluding the cameras? Movements limited to the office here, so can't check by myself.

Link to comment
Share on other sites

@zzy @VibrantNebula Received the Leap Motion, was looking at the best way to mount it. Since the 3M stich it's one use didn't want to trial and error.

In this way I'm using his mouIMG_20200319_193901.thumb.jpg.e198837aa74936e9ff035a814dcae9ed.jpgIMG_20200319_193913.thumb.jpg.7c690211662f884c8503a18d21a01ae2.jpgnting kit, will create troubles with the headset tracking? Controllers tracking it's not more a problem in this case

Edited by davide445
Link to comment
Share on other sites

I finally mounted the Leap Motion using a biadhesive so to have (for test purpose) the most flexible installation

spacer.png

That said the experience it's better than with HTC SDK but not reliable as was supposed to be in my expectations. 

Waiting for any improvement suggestions from Ultraleap, wanted to ask @zzy if wearing a glove with stamped different markers on any finger will help improving the tracking using the native SDK.

I'm starting to wonder if in general the whole hand tracking its still an r&d topic and not ready for prime time. 

Edited by davide445
Link to comment
Share on other sites

Hi @davide445

Glad to know you have mounted leap motion successfully. About your question, wearing a glove does not help for Vive Hand Tracking SDK, since our SDK is trained with hands without gloves. Here are some suggestion you can try:

  1. Roll up sleeves and take off your watch if any
  2. Avoid light sources in the background, including window and lights
  3. Try to make your room brighter (e.g. turn on the lights even in day time), but don't look at light sources directly
Link to comment
Share on other sites

Thanks @zzy but my idea was not simply gloves but gloves with attached specific QR markers for each finger.

Since you are using a DNN I suppose you will need to train it with also this markers, but this might improve the recognition. 

Also from the user point of view I didn't see a problem in wearing passive simple gloves provided with markers stamped. 

I'm searching and effective solution to a problem I didn't see one so far. 

Link to comment
Share on other sites

spacer.png

Just to give an idea. In this way you can also I suppose increase your training set size by also generating it trough 3d simulation, since your focus will be not in fact a real hand but a glove, easier to render.

I know I'm now speaking more about R&D, but if correctly working reliably a native hand tracking using just Cosmos cameras would be the perfect solution.

Link to comment
Share on other sites

Hi @davide445

Thanks for the suggestion. I agree that a native working hand tracking using HMD front camera would be perfect solution, this is our goal for the Hand Tracking SDK.

We will consider your suggestion, however since this will require more resources and not as scalable as raw hands, we will put it at lower priority.

Link to comment
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
×
×
  • Create New...