search

AMontgomerie / question_generator

An NLP system for generating reading comprehension questions
MIT License
281 stars 72 forks source link

missing dataset #1

Closed Neuronys closed 4 years ago

Neuronys commented 4 years ago

Hi @iarfmoose Thanks for sharing this T5 example on question generation task. The dataset you used for training is not included in the repo

train_set = QGDataset(os.path.join(DIR, 'question_generator/datasets/qg_train.csv')) train_loader = DataLoader(train_set, batch_size=BATCH_SIZE, shuffle=True) valid_set = QGDataset(os.path.join(DIR, 'question_generator/datasets/qg_valid.csv')) valid_loader = DataLoader(valid_set, batch_size=BATCH_SIZE, shuffle=False)

Would you be so kind to provide them ? Thanks in advance Philippe

AMontgomerie commented 4 years ago

Hi Philippe,

The datasets are too large to upload to the repo but here's a google drive download link

Neuronys commented 4 years ago

Thanks a lot @iarfmoose Have you found this repo already: https://github.com/patil-suraj/question_generation ? Cheers

AMontgomerie commented 4 years ago

No problem!

Yeah I came across that one after uploading my project. It seems to be a lot more in-depth than mine!