Looking for some guidance with a project

[IAILab]

Hello.

I am a university student working on my final project using an HTC Vive Pro. The goal of said project is to implement a segmentation algorithm like SAM in the headset using the footage from the front facing cameras.

So I would need to have access to the camera images, process them and then display them back once processed on the headset's screens. I was hoping that you could point me in the direction of some development tools, documentations, projects, that could help me achive this.

Thank you.