Spawn object over the created real world mesh (the mesh that we created from the Mixed Reality in XR Elite)

[crdm21]

Hello, im trying to make a simple game that need to scan our real world environment (i have done that using the Mixed Reality setup in the glasses), but when i run the ScenePerception sample project to the glasses, it looks like the raycast from the controller not detecting the real world environment that we have setup before (but we can see the created mesh visualized with the green line), how can i achieve my goal?

[VIVE_chengnay]

Hi @crdm21,

Could you screenshot what you see in your app?

Are you referring to ScenePerceptionDemo(SceneMeshAnchor) sample scene?

[crdm21]

you can see the screenshot here: https://ibb.co/mJRfBLt
and the video recording here: https://drive.google.com/drive/u/2/folders/1CUUktCZymTD74tl197HghqviRlQHMaIS

yes i'am referring to ScenePerceptionDemo(SceneMeshAnchor), as you can see on the video the mesh visualization can be seen, but i can't interact with it..
i'm just thinking is the mesh visualization just a visualization or is it has a collider setup within it..

if it dont have collider how do i setup it..

Edited March 20 by crdm21
adding more information

[VIVE_chengnay]

Hi @crdm21,

May I know which Wave SDK version did you use for your project?

[crdm21]

its 5.2.0-r.8, im not changing anything from the sample scene

 

Edited March 20 by crdm21
adding more information

[VIVE_chengnay]

Hi @crdm21,

There is newer version of Wave SDK available.

Feel free to update to the latest one.

And, below is the quick patch for adding MeshCollider for your need.

I modified the GeneratedSceneMeshContainer.cs file.

private GameObject GenerateNewGameObject(SceneMesh sceneMesh)
{
	//Log.d(LOG_TAG, "Add new scene mesh");
	GameObject newSceneMeshGO = ScenePerceptionObjectTools.GenerateSceneMesh(scenePerceptionManager, sceneMesh, generatedMeshMaterialWireframe, false, context.GetTrackingOrigin());

	if (newSceneMeshGO == null)
		return null;

	//Process Mesh For Wireframe rendering
	MeshFilter generatedSceneMeshFilter = newSceneMeshGO.GetComponent<MeshFilter>();
	if (generatedSceneMeshFilter && generatedSceneMeshFilter.mesh)
	{
		Mesh generatedSceneMeshInstance = generatedSceneMeshFilter.mesh;
		generatedSceneMeshFilter.mesh = ProcessSceneMeshForWireframe(generatedSceneMeshInstance);

        // Add below two lines
		var meshCollider = newSceneMeshGO.AddComponent<MeshCollider>();
		meshCollider.sharedMesh = generatedSceneMeshInstance;
	}

	return newSceneMeshGO;
}

Let me know if you have questions, thanks!

NOTE: I test and verify with Wave SDK 5.6.0-r.10.1.

[crdm21]

okey thankyou for your solution, i will try it out..

so if the solution is to add the collider manually, that means the scene mesh that we have generate before doesn't have its collider built-in with it when we scan our room? 

[crdm21]

Hi @VIVE_chengnay, i upgrade my Wave SDK to 5.6.0-r.10.1 but getting this error https://imgur.com/a/vgIVr3S.
im using unity 2021.3.28f1

[VIVE_chengnay]

Hi @crdm21,

From your screenshot, it looks like you are using 5.6.0-r.10.2?

Could you share the console log after you clicked "OK"? Thanks!

[crdm21]

2 hours ago, VIVE_chengnay said:

Hi @crdm21,

From your screenshot, it looks like you are using 5.6.0-r.10.2?

Could you share the console log after you clicked "OK"? Thanks!

sorry for the confusion, i just making a new project and install the 5.6.0-r.10.1 and it works as expected, another question about the scene perception, so the scene mesh and scene planes is two different concepts, the scene mesh is for our surrounding (room), and scene plane for flat stuff like table, window, wall etc? am i right?