search

microsoft / HoloLensForCV

Sample code and documentation for using the Microsoft HoloLens for Computer Vision research
MIT License
475 stars 154 forks source link

Project "Recorder" doesn't capture the Photo/Video image. #60

Closed SongYx1995 closed 6 years ago

SongYx1995 commented 6 years ago

I ran the project "Recorder" and got many files such as long_throw_depth.tar,etc However ,the file pv.tar turned out to be empty. How should i get pv images which has One-to-one correspondence with depth image?

ahojnnes commented 6 years ago

You would have to change the source code of the recorder application. Currently the photo video camera is not recorded. See Recorder/AppMain.cpp at the very bottom. Let me know if anything else is unclear.

SongYx1995 commented 6 years ago

@ahojnnes Thanks,I managed to get the PV image by modifying the code in AppMain.cpp and SensorFrameRecorderSink.cpp as you said. However the PV Image has a quite different view from the depth image,which doesnt meet my need.So is there any way i can get a RGB image which matches closely to the depth image?(ps: I want to do some machine learning works using the RGB images and the corresponding depth images).What about the reflectivity-image? I'm looking into it now.......

ahojnnes commented 6 years ago

The research mode gives you the sensor poses for both the PV camera and the depth sensor, so you could reproject the depth images to the PV image (including some occlusion handling).