Streaming Live Camera Feed into the Vive Headset

[VolsungaSaga]

Hello,

I am a software engineer at NASA's Johnson Space Center, and I've got some questions regarding the Vive's software interface.

The objective of my team is to provide a virtual reality teleoperation interface to the Valkyrie robot, using two cameras to provide stereoscopic vision to somebody using the Manus VR gloves and HTC Vive Trackers to manipulate the robot's arms, so that they can see what they're doing.

We've been using Unity to render the incoming camera images onto planes that are positioned in front of the cameras, whose resulting views are then put into the Vive screens through the black-boxy SteamVR array of scripts. However, there exist YouTube videos and other records of people being able to put incoming images into the VIVE screens directly without resorting to the roundabout methods I'm using now.

I would like to know if any of you fine folks know how to access the VIVE's two screens and render JPEG images onto them.

Please don't hesitate to ask for clarifications about this question!

 

@Jad

 

[Jad]

On 2/26/2020 at 5:40 PM, VolsungaSaga said:

Hello,

I am a software engineer at NASA's Johnson Space Center, and I've got some questions regarding the Vive's software interface.

The objective of my team is to provide a virtual reality teleoperation interface to the Valkyrie robot, using two cameras to provide stereoscopic vision to somebody using the Manus VR gloves and HTC Vive Trackers to manipulate the robot's arms, so that they can see what they're doing.

We've been using Unity to render the incoming camera images onto planes that are positioned in front of the cameras, whose resulting views are then put into the Vive screens through the black-boxy SteamVR array of scripts. However, there exist YouTube videos and other records of people being able to put incoming images into the VIVE screens directly without resorting to the roundabout methods I'm using now.

I would like to know if any of you fine folks know how to access the VIVE's two screens and render JPEG images onto them.

Please don't hesitate to ask for clarifications about this question!

 

@Jad

 

Hi DM sent. You can use the SRWorks SDK. I will follow-up with you directly. Thanks. 

[matthlap]

Exact same problem here can I get more information as well ?

[dlm080]

I am trying to do the exact same thing as well.  Could you share some of the more detailed information?  Thanks!