search

DAMO-DI-ML / KDD2023-DCdetector

189 stars 21 forks source link

About the results in MSL dataset #14

Open LukaZLionel opened 1 year ago

LukaZLionel commented 1 year ago

Nice work! But I met a problem, when I run the script in your code to MSL dataset, one of the results F-score is only 0.9397, which is not same as 0.96 in the report. I wonder if there is something I missed.

138291694255408_ pic

tianzhou2011 commented 1 year ago

image A quick run: This set of parameters yields an F1 score of 95.5 for me. However, Yiyuan may employed different sets of parameters resulting in an F1 score of 96.6. I apologize for any inconvenience caused, and please understand that due to busy schedule, it may take some time for him to reply.

yyysjz1997 commented 1 year ago

Nice work! But I met a problem, when I run the script in your code to MSL dataset, one of the results F-score is only 0.9397, which is not same as 0.96 in the report. I wonder if there is something I missed.

138291694255408_ pic

Thank you for your feedback. In the paper, we presented the results after averaging, but the final outcomes might be influenced by hardware conditions, the python package version and shuffling operation, among other factors. Further testing can be conducted by altering certain hyperparameters, such as window size, patch size and so on. I hope this helps.