Pretrain ResNet-50 with autoattack

[AlbertoSinigaglia]

Hi everybody,
First, thanks for the repo and the work you are carrying out... a very small question: do you plan also to try to train on ImageNet a ResNet-50 (or other architectures) and see if adversarial pretraining is effective? All the models you offer seem to be some sort of adversarial defense "mythbusting", but I can't find any (adversarial) pretraining using AutoAttack

[dedeswim]

Hi, do you mean running adversarial training using AutoAttack as an attack for generating adversarial examples at each training step? If so, then it's not really practical because of the time needed to run AutoAttack. AutoAttack is meant as an attack to evaluate robustness, rather than as an attack to do adversarial training with. Please let us know if this helps!

[AlbertoSinigaglia]

@dedeswim exactly, using adversarial training with AutoAttack as an adversarial defense, like what Madry did here with projected gradient descent

[dedeswim]

I understand. However, we don't train models ourselves, but rather benchmark and host models trained by other researchers, so we are not planning to train such model. I hope this helps!

[AlbertoSinigaglia]

Hi @dedeswim yup, just wanted to be sure that no model was available before training it myself, thanks anyway!

[dedeswim]

No problem!