search

19reborn / NeuS2

[ICCV 2023] Official code for NeuS2
Other
621 stars 40 forks source link

bad result with neuspp without mask #70

Open maorp opened 6 months ago

maorp commented 6 months ago

Hi, first thank you for this amazing work. I have a custom dataset and im trying using neuspp. i sometimes get bad result when the captured person is not in the middle of the images. this dataset is from a setup with 35 static calibrated cams. I can supply the data for debug if needed. i get good result when the person stands close to the center. here is gui screenshot - seems like the bg nerf didnt reach a good state so the sdf tried to fill the cube: image

maorp commented 6 months ago

here is a result with same cameras but when the person close to center: image

maorp commented 6 months ago

since the person is almost outside of aabb i also tried enlarging to "aabb_scale": 2 - but it seems neuspp does not handle it and i get zero samples per ray with it...

albb20 commented 5 months ago

Hi, i think i have read somewhere that for NeuSPP, scale must be =1, i.e. the scene must take place inside the cube at any time. Maybe you should try to rescale.

19reborn commented 5 months ago

@maorp Hi, thanks for using our codes. Just as @albb20 suggested, you can tune scale smaller while fixing aabb_scale to 1.

maorp commented 5 months ago

Thanks. Ill retry a smaller scale factor.

maorp commented 5 months ago

hi again, tried scale: 0.25, but still bad results. it starts optimizing and then stops with loss: Nan. i can send the data if needed... image

Johnnymike20 commented 2 months ago

hi@maorp, I wonder how to apply GUI in NeuS2 Project?