princeton-vl / DROID-SLAM

BSD 3-Clause "New" or "Revised" License
1.66k stars 273 forks source link

Method for giving rgbd data as input #78

Closed SuruchiPokhrel closed 1 year ago

SuruchiPokhrel commented 1 year ago

I have been using demo.py with custom dataset and the results are sparse. DROID-SLAM is supposed to take stereo and rgbd as input, but i dont see any way supplying rgbd input for demo.py . Is there any way of doing so ?

felipesce commented 1 year ago

https://github.com/princeton-vl/DROID-SLAM/issues/45#issuecomment-1135551368

SuruchiPokhrel commented 1 year ago

I tried the same for my depth input from Kinect camera, but did not really see any pointclouds during reconstruction, and also the camera trajectory seems really off. What is the source of your depth input?

zovelsanj commented 1 year ago

try this:

depth = depth.astype(np.float32) / 5000.0
depth = torch.from_numpy(depth).float()[None,None]
depth = F.interpolate(depth, (h1, w1), mode='nearest').squeeze()
depth = depth[:h1-h1%8, :w1-w1%8]