softsys4ai / athena

Athena: A Framework for Defending Machine Learning Systems Against Adversarial Attacks
https://softsys4ai.github.io/athena/
MIT License
41 stars 9 forks source link

Investigation on the difference of inference time between BS and AE #10

Closed oceank closed 4 years ago

oceank commented 5 years ago

So far, we have empirical evidence that shows there is a significant difference between BS and AE in terms of inference time on the clean model and many transform models. Check the column "inference Probability" in Inference_Time-T_Test.xlsx for the t-test result of inference time of BS and AE on every model.

Question: what is the root cause of this difference?

Investigation idea:

  1. Which part of NN layers (lower layers or upper layers) has more impact on this difference? measure the time cost for each layer for both BS and AE

  2. Do the inferences of BS and AE result in a different number of neurons to be activated

MENG2010 commented 4 years ago

done