mzweilin / EvadeML-Zoo

Benchmarking and Visualization Tool for Adversarial Machine Learning
https://evadeML.org/zoo
MIT License
187 stars 63 forks source link

what is difference between listed pretrained models #2

Closed wengbrian closed 4 years ago

wengbrian commented 5 years ago

Hi, I want to ask that what is difference between "PGDbase" and "PGDtrained" model listed in here for MNIST dataset. Also, there seems to exist two Cleverhans MNIST for mnist which I found in your code here, what is difference between these two model? Final, can you provide training detail that how is these models pretrained? for example, how many epoch used to train each of these model or some setting?

mzweilin commented 4 years ago

The "cleverhans" means the model architecture is from the MNIST example in Cleverhans. We have two models with the same prefix, one is adversarially trained while the other is not, so that you can compare the robustness property.

Sorry, I didn't document the training protocol for the models.

Best, -Weilin