Closed HashmatShadab closed 1 year ago
Hi, The main part of training recipe for downstream tasks can already be found in App. C.4. We use AdamW as optimizer and train with regular CE loss (similar to ImageNet training). We have never used TRADES in our work. Hope this helps.
Thank you!
Can you please provide in more detail the training recipe used for adversarial finetuning on downstream datasets(cifar10, cifar1000, flowers)? What optimizer, augmentations are used? Is the adversarial training done similar to how it is done on ImageNet or TRADES framework is used?