YihongSun / Dynamo-Depth

[NeurIPS 2023] Dynamo-Depth: Fixing Unsupervised Depth Estimation for Dynamical Scenes
https://dynamo-depth.github.io
MIT License
69 stars 5 forks source link

Training Scheme on Waymo #11

Closed Brummi closed 2 months ago

Brummi commented 2 months ago

Dear authors,

thanks for sharing your nice work! I am currently also trying to train Monodepth2 on waymo and I am running into some stability issues.

Did you modify the training code for Monodepth2 in any way when training it on Waymo?

Many thanks in advance! Best, Felix

YihongSun commented 2 months ago

Hi Felix,

Thank you for your interest in our work!

As far as I can recall, when evaluating Monodepth2 on Waymo Open, we just followed the official codebase and training procedure. From our investigations, small variations in learning rate, schedule, and number of epochs didn't appear to affect Monodepth2 performance at convergence.

Can you elaborate on the stability issue that you are running into? From our experience, the predominate errors that we observed are for dynamical regions, as shown by Figure 2 in the paper.

Hope this helps!

YihongSun commented 2 months ago

Closing this issue due to inactivity. Feel free to reach out if you have additional questions!