nianticlabs / manydepth

[CVPR 2021] Self-supervised depth estimation from short sequences
Other
607 stars 84 forks source link

Depth estimation from underwater monocular video sequences #50

Closed buster-zbb closed 2 years ago

buster-zbb commented 2 years ago

Hi@mdfirman @daniyar-niantic , Thanks for your work! I tested your model in the underwater data set, but the effect is not very good. after debugging, the loss function drops normally, and the pose network can work normally, but the final result is very strange.the depth data is almost between 0.01-0.15m. I want to ask whether is the model doesn't work for this type of dataset,?here are some images from my dataset, do you know what's the problem?Thanks! 3415 3415_disp_multi 3048 3374 4856

daniyar-niantic commented 2 years ago

Hi.

It is hard to say exactly what is the problem, but could you try training at lower resolution to see if that works?

buster-zbb commented 2 years ago

@daniyar-niantic @mdfirman , I tried to use the pre-trained model in kitti, the size used for training is 192*640, but the effect has not improved. I wonder if the model will work on this underwater dataset.

daniyar-niantic commented 2 years ago

The depthmap in your question is much higher resolution than that. How are you generating these depthmap? At test time you should use the same resolution as training resolution.

buster-zbb commented 2 years ago

The depthmap in your question is much higher resolution than that. How are you generating these depthmap? At test time you should use the same resolution as training resolution. The depth map is obtained from running test_simple.py from the code you guys provided, I think the biggest problem is that the depth value of the training output stays between 0.01-0.15m, which is very strange.