search

Tencent / DepthCrafter

DepthCrafter: Generating Consistent Long Depth Sequences for Open-world Videos
https://depthcrafter.github.io
Other
976 stars 49 forks source link

Evaluation Clipping #28

Open Davidyao99 opened 1 month ago

Davidyao99 commented 1 month ago

I was looking through the evaluation script and was wondering why do we perform this clipping of depth values here

I was wondering if we can perform clipping of predicted depth values before the alignment stage. I notice that for my prediction, there were some extreme outlier values that led to poor shift / scale alignment values that led to extremely poor results for that particular scene. I was wondering if you have any advice / guidance for such an issue?

Thank you! and great work!

gaoxiangjun commented 1 month ago

Since we need to calculate relative depth through 1/disp, in some cases, we found extremely low disp would result in a huge depth, which would influence the align stage and tend to align more towards the large depth. Furthermore, this led to poor shift/scale alignment values.