Harry24k / adversarial-attacks-pytorch

PyTorch implementation of adversarial attacks [torchattacks].
https://adversarial-attacks-pytorch.readthedocs.io/en/latest/index.html
MIT License
1.79k stars 337 forks source link

[QUESTION] What is the difference between autoattack.py in this repository and autoattack.py in the auto-attack repository? #164

Open seopp opened 10 months ago

seopp commented 10 months ago

❔ Any questions

Hi, thanks for the great work. I'm trying to use autoattack.py to evaluate the robustness of my model. In my experiments, it seems that using autoattack.py in this repository versus autoattack.py in the auto-attack repository gives different results. I think I'm setting up the experiment incorrectly, as the two results should be the same. So I'm wondering what the difference is between autoattack.py in this repo and autoattack.py in the auto-attack repo. Thanks for providing such a great library.

Harry24k commented 8 months ago

Could you upload the code for me? In the latest version, the robust accuracy against AutoAttack was the same. Note that the randomness can result in a little bit different results.