search

CEA-LIST / adv-reid

Metric Adversarial Attacks and Defense
Other
18 stars 4 forks source link

Evaluation of defended Model #4

Open asthaverma13 opened 3 years ago

asthaverma13 commented 3 years ago

After training the defended model GOAT, when i am attacking this model, it is giving accuracy as rank1 : mean = 0.0008907363517209888, max = 0.0008907363517209888, min = 0.0008907363517209888, std = 0.0 rank5 : mean = 0.0029691210947930813, max = 0.0029691210947930813, min = 0.0029691210947930813, std = 0.0 rank10 : mean = 0.00801662728190422, max = 0.00801662728190422, min = 0.00801662728190422, std = 0.0 map : mean = 0.0020973790522167803, max = 0.0020973790522167803, min = 0.0020973790522167803, std = 0.0 Total computing time : 161.57796907424927 sec

Whereas, as stated in the paper, the accuracy should be higher after attacking the defended model.

Please provide me the checkpoints of defended model.

Thanks and Regards Astha Verma PhD Scholar

qbouniot commented 3 years ago

Hello ! Thank you for your interest in our work. Can you tell me which command did you run to train the model ? I'm currently reviewing the code to correct some mistakes. I will upload the checkpoints soon, they should be available in the following week.

asthaverma13 commented 3 years ago

Thanks for your reply. I used the following command for defending the model by giving my arguments in place of output_folder, dataset_folder, dataset and checkpoint_name

python train.py \

\ \ --dataset \ --lr 0.00035 \ -wd 5e-4 \ -n 60 \ -f \ -b 32 \ --classif \ --pretrained \ --adv \ --inter \ --pull Please upload the defended model as soon as possible. Astha
qbouniot commented 3 years ago

Hello ! We have uploaded checkpoints of the defended models, the links are now in the readme. I hope this will help you.

asthaverma13 commented 3 years ago

Thanks a lot. I will check it out.

Astha

On Tue, Sep 28, 2021, 20:40 Quentin Bouniot @.***> wrote:

Hello ! We have uploaded checkpoints of the defended models, the links are now in the readme. I hope this will help you.

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/CEA-LIST/adv-reid/issues/4#issuecomment-929322802, or unsubscribe https://github.com/notifications/unsubscribe-auth/AKBFLWHTGANA7DOIGAZC6S3UEHLG7ANCNFSM5A3MM6YQ . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.