search

rwightman / gen-efficientnet-pytorch

Pretrained EfficientNet, EfficientNet-Lite, MixNet, MobileNetV3 / V2, MNASNet A1 and B1, FBNet, Single-Path NAS
Apache License 2.0
1.56k stars 214 forks source link

meaning of `ns` vs `ap` #69

Closed Borda closed 2 years ago

Borda commented 2 years ago

Hello, may I have an n00b question, what is the meaning of these two abbreviations ns and ap? :rabbit:

Borda commented 2 years ago

AdvProp is an adversarial training scheme that treats adversarial examples as additional examples, to prevent overfitting. Key to the method is the usage of a separate auxiliary batch norm for adversarial examples, as they have different underlying distributions to normal examples. (from tf-efficientnet-b3-ap)

Noisy Student Training is a semi-supervised learning approach. It extends the idea of self-training and distillation with the use of equal-or-larger student models and noise added to the student during learning. The algorithm is iterated a few times by treating the student as a teacher to relabel the unlabeled data and training a new student. (from tf-efficientnet-b7-ns)