search

manigalati / usad

Other
204 stars 58 forks source link

Threshold Definition #10

Open ServetKocak opened 2 years ago

ServetKocak commented 2 years ago

Hi @manigalati , I am wondering how did you implement the threshold as AUC score? Isn't the AUC score is the kinda accuracy of the model. If you check the maximum value of y_pred, it is lower than the AUC score thus In the paper, they don't explain how did they set the threshold.

ly1112 commented 1 year ago

Hi, have you figured out this? I am also quite confused about this. Thanks a lot!

ServetKocak commented 1 year ago

Hi @ly1112, I contacted to author of the paper and he said "In the paper we normalized the anomaly scores between 0 and 1.0 and then tested 10 000 thresholds (0.0001 , 0.0002 , ....)."

I also found another USAD application and they did the following: image

Good luck!

ly1112 commented 1 year ago

Hi @ly1112, I contacted to author of the paper and he said "In the paper we normalized the anomaly scores between 0 and 1.0 and then tested 10 000 thresholds (0.0001 , 0.0002 , ....)."

I also found another USAD application and they did the following: image

Good luck!

Hi. thank you so much for your helpful reply! So they are doing a grid search on all possible threshold, which will be quite time-comsuming..... As for your another find, they are more easy to impliment. May I ask, can you share the link of these application? And did you reproduce the results of the paper based on the new application on threshod? Thanks a lot!

dadodimauro commented 1 year ago

Hi @ly1112, I contacted to author of the paper and he said "In the paper we normalized the anomaly scores between 0 and 1.0 and then tested 10 000 thresholds (0.0001 , 0.0002 , ....)."

I also found another USAD application and they did the following: image

Good luck!

hi @ly1112 , where did you find this implementation? Thanks for your help

Jhonzhang commented 1 month ago

Hi @ly1112 @ServetKocak @dadodimauro
Can you share the complete code with the best implementation? The code published by the original author is not complete. Thanks for your help！

dadodimauro commented 1 month ago

Hi @ly1112 @ServetKocak @dadodimauro

Can you share the complete code with the best implementation? The code published by the original author is not complete.

Thanks for your help！

Hi, I can only suggest you to look at my public repo called anomaly detector where I implemented the USAD algorithm to find anomalies in an oracle database.

I did my masters thesis work on that, unfortunately I don't remember well the specifics, here you can find my thesis, I hope you find it useful thesis

Cheers