TQTQliu / ET-MVSNet

[ICCV 2023] When Epipolar Constraint Meets Non-local Operators in Multi-View Stereo
MIT License
62 stars 1 forks source link

Fairness of Ablation Experiments #9

Open YuhsiHu opened 6 months ago

YuhsiHu commented 6 months ago

Thank you for your response in issue: Modification of point cloud fusion method, however, it does not address my concerns. Is it fair to attribute the DTU score improvement brought about by changing the fusion method to the ET module?

In the baseline results, it seems that you utilized a default fusion method, but for your proposed ET module, there appears to have been a switch to your updated fusion method. This change seems to have led to performance improvements being attributed to the ET module, which may not entirely reflect its true impact. The MVSTER method achieves comparable scores using the updated fusion method alone on DTU, without the need for the ET module. Therefore, attributing the performance gains solely to the Epipolar Transformer in the ablation study seems unfair.

I appreciate your time and attention to these inquiries. I believe that addressing these concerns will not only enhance the credibility of this research but also contribute to the advancement of our understanding of the MVS field.