enricivi / adversarial_training_methods

Implementation of the methods proposed in **Adversarial Training Methods for Semi-Supervised Text Classification** on IMDB dataset (without pre-training)
MIT License
40 stars 11 forks source link

About VAT loss #9

Open Snowfy1031 opened 4 years ago

Snowfy1031 commented 4 years ago

In the paper, author said "Although we also in general cannot analytically calculate the virtual adversarial loss, Miyato et al. (2016) proposed to calculate the approximated Eq.(3) efficiently with backpropagation. "

you didn't use Bilstm, Does it affect VAT loss and other calculations?