search

modelscope / richdreamer

Live Demo：https://modelscope.cn/studios/Damo_XR_Lab/3D_AIGC
https://aigc3d.github.io/richdreamer/
Apache License 2.0
396 stars 14 forks source link

Some random points in depth wrapping #32

Closed irimsky closed 5 months ago

irimsky commented 5 months ago

Hello, your dataset is a great job and I am testing on it. I have tried the depth wrap script example you gave in repo. However I found when reprojecting, there are some random noisy points away from the original model just like the picture below:

image

I tried different models and different angels, and the I got the same result. I have no idea what causes this.

irimsky commented 5 months ago

I may find out the reason. I debugged by writing out the original uv coords of these random points, and found that they all belong to the edge of model. And their depth are all have a sharp descend like this:

image image

Did you ever do any anti-aliasing on your normal and depth data?

lingtengqiu commented 5 months ago

Hi, The error is caused by single-direction projection. you can smooth the projection error with a high-freq filter.

irimsky commented 5 months ago

what is 'single-direction projection' ? And I am trying to get the 3d coordinates of these points. A simple filtering cannot solve this 3d random points.

yjb6 commented 1 month ago

I found the same problem here, do you get any good solutions? thanks [#51]

irimsky commented 1 month ago

I found the same problem here, do you get any good solutions? thanks [#51]

Not yet. I have found another similar dataset called Cap3D