BunnySoCrazy / SECAD-Net

This repository provides the official code of SECAD-Net.
MIT License
40 stars 6 forks source link

Issue on Evaluation values reported #3

Closed Sangminhong closed 6 months ago

Sangminhong commented 11 months ago

Dear authors, thank you for your interesting work!

While going through your paper, I have found that the evaluation values (CD, ECD, NC) for related works (USG-Net, CSG-Stump) are different from those reported on CAPRI-Net. According to the paper, the experiment setting is same as that in CAPRI-Net so do you know why there is some difference in the values? And could you tell me how you computed the values?

Thank you

BunnySoCrazy commented 8 months ago

Hi Sangminhong,

Our evaluation code primarily draws upon BSP-Net. This link contains the code for all the metrics referenced in the paper. I will publish our code along with further details soon. Your interest and patience are much appreciated.

Best regards, Pu

BunnySoCrazy commented 6 months ago

Hello Sangminhong,

The inconsistent results are mainly due to the different subsets of the ABC data set we selected. I've just uploaded the evaluation code and ABC test list here. If you have any questions, please let me know.

Best regards, Pu