This PR adds support for the following datasets found in torchtext
AG_NEWS
DBpedia
IMDB
SogouNews
YahooAnswers
YelpReviewPolarity
I added dataset classes, as well as adjusted the __main__ scripts for the models to incorporate these datasets.
To download and process them, refer to datasets/README.md (it involves using a different virtual environment because different versions of torchtext are needed). Datasets are placed in .local_data/<dataset_name>.
Models supporting these datasets are:
Reg-LSTM
HAN
Char-CNN
Kim CNN
This PR is really big, but most files are nearly identical (maybe it should be refactored in favor of DRY pattern)?
This PR adds support for the following datasets found in torchtext
I added dataset classes, as well as adjusted the
__main__scripts for the models to incorporate these datasets.To download and process them, refer to
datasets/README.md(it involves using a different virtual environment because different versions of torchtext are needed). Datasets are placed in.local_data/<dataset_name>.Models supporting these datasets are:
This PR is really big, but most files are nearly identical (maybe it should be refactored in favor of DRY pattern)?