glin2022 / atop

The code of the ICLR 2024 paper: Adversarial Training on Purification (AToP): Advancing Both Robustness and Generalization
8 stars 0 forks source link

Request for environment information #1

Closed Return-vo1d closed 2 months ago

Return-vo1d commented 3 months ago

Could you please provide the environment information for the model?

glin2022 commented 3 months ago

We use the code from DeepFill. You can use this github to build the basic environment. For the attacks in the paper, you can find in RobustBench and torchattacks.

Return-vo1d commented 2 months ago

Thank you very much for your previous response. I have one more question. I noticed that you're using a pre-trained model from DeepFill, but since DeepFill is based on TensorFlow and your training code is in PyTorch, do I need to convert the DeepFill pre-trained model to a format that PyTorch can recognize? Alternatively, could you kindly provide the pre-trained model you're using? I would greatly appreciate it!

glin2022 commented 2 months ago

Thank you very much for your previous response. I have one more question. I noticed that you're using a pre-trained model from DeepFill, but since DeepFill is based on TensorFlow and your training code is in PyTorch, do I need to convert the DeepFill pre-trained model to a format that PyTorch can recognize? Alternatively, could you kindly provide the pre-trained model you're using? I would greatly appreciate it!

Sorry for some oversights in information verification. We have now updated the relevant information: we use the code from deepfillv2-pytorch, a PyTorch reimplementation of DeepFillv2 based on the original TensorFlow implementation.

Return-vo1d commented 2 months ago

Hello, I used the deepfill pre-trained model you provided and the config file that came with the project to train for 250 epochs on a 3090 GPU. Although the g_loss has been generally decreasing, the generated images throughout the training are very poor, and the masked areas are mostly filled with repetitive patterns. Have you encountered a similar problem before?

glin2022 commented 2 months ago

Thanks for your continued interest in our work. In response to your question, the answer is YES. The generated images (i.e., purified examples) may look poor visually.

  1. In the generator-based AP methods, the purifier model $g$ is not required to satisfy $g(x+\delta)=x$. In general, we only focus the classification accuracy.
  2. In our code, we save the checkpoints for each epoch and select the best checkpoint for subsequent evaluations. Although we train for 300 epochs, we have observed that the best results are mostly concentrated in the first 50 rounds, and too many rounds could indeed impact the quality of the generated images.
  3. There are more visualization results in Appendix of our paper (In complex scenarios, RT3 generates images that look poor, as shown in Figure 9), and similar results in Figure 2 of another paper.