Xharlie / DISN

(latest updates and bug fixed) DISN: Deep Implicit Surface Network for High-quality Single-view 3D Reconstruction
183 stars 27 forks source link

different evaluation results #24

Closed yigepingzi closed 2 years ago

yigepingzi commented 2 years ago

Thanks for uploading the code. I set up the environment and downloaded the pre-trained model SDF_DISN. Following the given config I generated the iso object for watercraft and run the test code.

min_cf:3.0742388, arg_cf view:12, avg emd:4.351789, min_emd:1.5337949, arg_em view:12 1 /home/pingzi/nvme/datasets/DISN_datasets/march_cube_objs_v1/04530566/ffffe224db39febe288b05b36358465d/isosurf.obj avg cf:34.068142, min_cf:1.9948646, arg_cf view:6, avg emd:2.78306, min_emd:1.1900781, arg_em view:6 1 /home/pingzi/nvme/datasets/DISN_datasets/march_cube_objs_v1/04530566/5fb24b87514df43a82b0247bfa21216b/isosurf.obj avg cf:14.799217, min_cf:3.808662, arg_cf view:7, avg emd:2.4966927, min_emd:1.8077142, arg_em view:18 1 /home/pingzi/nvme/datasets/DISN_datasets/march_cube_objs_v1/04530566/8605c975778dc8634c634743f56177d4/isosurf.obj avg cf:11.427704, min_cf:3.1768718, arg_cf view:6, avg emd:2.4085941, min_emd:1.7498852, arg_em view:5 1 /home/pingzi/nvme/datasets/DISN_datasets/march_cube_objs_v1/04530566/98da594a65640370c8333f6c4d99e2c8/isosurf.obj avg cf:19.673376, min_cf:10.119444, arg_cf view:13, avg emd:4.026104, min_emd:2.98802, arg_em view:13 cat_nm:watercraft, cat_id:04530566, avg_cf:19.050472438177316, avg_emd:2.8231411160461466 done!

The result CD loss is 19.0504 EMD loss is 2.823. This is very different from your paper "cd:10.87,emd:2.55" I don't know where is wrong. Could you help me to figure it out?

I visualized the model and it looks correct. But sometimes there are outliers. Did you run any algorithm to filter outliers?

Screenshot from 2022-03-01 17-19-50 Screenshot from 2022-03-01 17-19-59 Screenshot from 2022-03-01 17-20-34

yigepingzi commented 2 years ago

Fixed. I found I didn't run the clean script to clean the outliers.