小苗兜兜 Posted July 31 Posted July 31 We use Vive xr elite devices here. Development tools: Unity2021.3.39 Vive Openxr Plugin: 2.4.0 XR Interaction Toolkit: 2.5.4 Target platform: All-in-one (Android) During the development process, we want to support gesture and handle interaction at the same time (of course, not at the same time, but the user can switch). I see that there is a separate gesture grabbing object scene (HandGrab_RealHand) in the Demo of our official SDK. There is a separate input method scene (OpenXRInput). But there is no complete solution that can realize both interactions, including interaction with objects in the scene, interaction with UI, gesture contact object grabbing method or ray detection interaction. I tried to write ray interaction myself through OpenXRInput, but it did not run smoothly. So I saw some information about XR Interaction Toolkit, and a demo (HandsDemoScene) in it can meet my interaction needs, but after I published it and installed it on the Vive xr elite device, I found that there was no problem using the handle to interact with the objects and UI in the scene. But the gestures are not recognized. Only the handle is recognized. So I would like to ask, does our SDK support the XR Interaction Toolkit plug-in? What kind of settings does it need to support gesture interaction? Or how to use our Vive Openxr Plugin to achieve my needs similar to the XR Interaction Toolkit interaction above? I have tried many things here, including switching the unity version and modifying the openxr publishing settings, but none of them work. I hope to give some help, thank you very much! The following are related screenshots:
VIVE_chengnay Posted July 31 Posted July 31 Hi @小苗兜兜, Could you try checking Hand Tracking Subsystem in your last screenshot?
小苗兜兜 Posted July 31 Author Posted July 31 @VIVE_chengnayI tried to check Hand Tracking Subsystem but it didn't work.
VIVE_chengnay Posted July 31 Posted July 31 Hi @小苗兜兜, I will need to check the scene that you used. Get back to you later.
VIVE_chengnay Posted August 1 Posted August 1 Hi @小苗兜兜, Did you install Unity XR Hands? If yes, please check is your version 1.3.0? You MUST use 1.3.0 to get it work.
小苗兜兜 Posted August 1 Author Posted August 1 4 hours ago, VIVE_chengnay said: Hi @小苗兜兜, Did you install Unity XR Hands? If yes, please check is your version 1.3.0? You MUST use 1.3.0 to get it work. First of all, thank you very much for your answer. I have version 1.4.1. I tried to switch the version as you said. Indeed, I can see the gesture recognition content in the scene. However, in the scene, it can only trigger UI operations by touching the UI with a finger. I tried to pinch and grasp the displayed ray but it didn't work, and I couldn't grab and move anything that could touch the scene. So, does it need to set something else? Or do I need to change the version of XR Interaction Toolkit (currently using 2.5.4)? Thanks again. The following is a screenshot of the package manager:
小苗兜兜 Posted August 2 Author Posted August 2 18 hours ago, 小苗兜兜 said: First of all, thank you very much for your answer. I have version 1.4.1. I tried to switch the version as you said. Indeed, I can see the gesture recognition content in the scene. However, in the scene, it can only trigger UI operations by touching the UI with a finger. I tried to pinch and grasp the displayed ray but it didn't work, and I couldn't grab and move anything that could touch the scene. So, does it need to set something else? Or do I need to change the version of XR Interaction Toolkit (currently using 2.5.4)? Thanks again. The following is a screenshot of the package manager: Hi@VIVE_chengnay, Could you give me some advice?
VIVE_chengnay Posted August 2 Posted August 2 Hi @小苗兜兜, We are checking the issue you reported. Get back to you later.
VIVE_chengnay Posted August 2 Posted August 2 Hi 小@小苗兜兜, You can learn the HandDemoScene here: https://docs.unity3d.com/Packages/com.unity.xr.interaction.toolkit@2.5/manual/samples-hands-interaction-demo.html You have to configure the InputAction mentioned here: https://docs.unity3d.com/Packages/com.unity.xr.interaction.toolkit@2.5/manual/general-setup.html You will need the VIVE XR Hand Interaction extension for grab and pinch actions: Use the "selectValue" of VIVE XR Hand Interaction extension: https://developer.vive.com/resources/openxr/unity/tutorials/hand-tracking/
ETET Posted August 2 Posted August 2 Hi,I am a novice in VR development. My leader has assigned me a requirement to use gestures to control movement (teleport). I watched the "Teleport" scene, which uses a handle to control movement (teleport). Which demo should I watch or what operation should I perform if I want to control movement with gestures? Thank you very much for your answer.
Recommended Posts
Create an account or sign in to comment
You need to be a member in order to leave a comment
Create an account
Sign up for a new account in our community. It's easy!
Register a new accountSign in
Already have an account? Sign in here.
Sign In Now