openphilanthropy / unrestricted-adversarial-examples

Contest Proposal and infrastructure for the Unrestricted Adversarial Examples Challenge
Apache License 2.0
329 stars 55 forks source link

Add end-to-end test on TCU-MNIST subset #9

Closed nottombrown closed 6 years ago

nottombrown commented 6 years ago

Running pytest should run a single end-to-end test that does the following:

nottombrown commented 6 years ago

The evaluate_tcu_mnist file does some of this already

catherio commented 6 years ago

are "L_infinity attack" and "L2 attack" referring to SPSA?

catherio commented 6 years ago

this works now, pardon the delay - got stuck on a silly bug - will merge & push later today

nottombrown commented 6 years ago

Woo! The two attacks were referring to SPSA and the Decision Boundary attack (before I knew the name for the Decision Boundary attack

nottombrown commented 6 years ago

Merged. Thanks!