Jump to content

mixed reality with google tilt brush

Recommended Posts

I think the devs that made job simulator have a guide and I'm sure HTC have a guide too. I'm on my phone now so can't find them but I'll look properly when I get home.


It involves a camera, capture card and a spare vive controller if I remember right.


I'll have look in a few hours if ya haven't found anything by then,



Link to comment
Share on other sites

  • 8 months later...

A bit late replying but I'm working through this at the moment as we have a tiltbrush artist who wants to use our green screen studio. This is where I've got to with my desk research... not easy but is doable if you have the right camera with a zoom...

Tiltbrush doesn't support the 4 way third controller output, but does have the static spectator camera output. Unfortunately the FOV is fixed at 80 degrees.

I'm lucky as I have an Pansaonic GH4 camera - with a 12-35mm lens, which at the wide end is 84 degrees, FOV. In theory zooming in a little should match the camera and spectator camera FOV and then its a case of making sure the camera is on a sturdy tripod and lining up the green screen and spectator camera correctly. You can do this by picking up the spectator camera using the Vive controller side grip buttons, flip up your headset and place the Vive circle on the front of the real cameral lens. You need to experiment to see exactly how the Vive controller relates to the spectator camera position, and may need to nudge the tripod a little. If it all works, I'll post some footage next time I'm in.

That the theory... but I was running some tests yesterday and I'd swear the FOV in Tiltbrush was higher than the GH4 at 12mm. I'll be experimenting with the video resolution and camera settings as it may be I'm losing the edges of the FOV when for example - enabling the in camera image stabilisation rather than optical lens based... neither of which is needed on a tripod but we usually shoot hand held!

We use a Elgato HD60S capture card on the GH4 and feed that into another PC, along with the output from the VR PC running Tiltbrush using OBS and Newtec NDI plugin to send across the network - saving having another capture card. But you can do it all on a single PC with decent specs. Our i7 6700k + 1080 manages it. We're looking to move to a black magic capture system as the Elgato is a bit laggy on our hand held MR videos - so you get mismatch in real / virtual hands when panning etc.

Link to comment
Share on other sites

  • 8 months later...
  • 5 months later...

You don't need a third controller nor additional tracker. Insude tiltbrush there is a option to position a stationary (or moving) virtual camera. Now all you have to do is to position virtual camera with physical and aligne them. Also it wolud be good for you using greenecreen so You can crop yourself out and merge virtual and physical camera feed togheter.

Link to comment
Share on other sites

  • 2 years later...
  • 1 month later...

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
  • Create New...