Tencent / DepthCrafter

DepthCrafter: Generating Consistent Long Depth Sequences for Open-world Videos
https://depthcrafter.github.io
Other
546 stars 20 forks source link

3D model in the output? #12

Open AbrahamLincoln33 opened 3 days ago

AbrahamLincoln33 commented 3 days ago

hi, can we have 3d reconstruction of input video in the output? like ".glb" files? (like point clouds in your github page)

gaoxiangjun commented 2 days ago

We don't conduct 3D recon, just depth estimation. The point clouds are visualized using "viser".

basit-MT commented 1 day ago

@gaoxiangjun is there a code for point cloud generation?

gaoxiangjun commented 1 day ago

@gaoxiangjun is there a code for point cloud generation?

I will upload a demo code for point cloud visualization next few days. Please stay tuned. :-)

gaoxiangjun commented 22 hours ago

@basit-MT Please check visualization_pcd.py. :-)

basit-MT commented 18 hours ago

Thanks @gaoxiangjun, works perfectly.

I had another question out of curiosity, do you think fine-tuning DepthCrafter to estimate metric Depth could give useful results? Have tried anything with the metric depth?

gaoxiangjun commented 11 hours ago

Yeah. It might be possible, but we haven't tried it yet.