search

ZhangShiyue / QGforQA

MIT License
96 stars 21 forks source link

About semi-supervised QA #13

Closed KazutoshiShinoda closed 3 years ago

KazutoshiShinoda commented 3 years ago

Hi, thank you very much for publishing the codes and data. They are very helpful because few research papers in QG publish their code or data.

Now I am trying to reproduce the result of the semi-supervised QA result in your paper using HarvestingQA dataset (https://github.com/xinyadu/harvestingQA/tree/master/dataset).

However, when I use your preprocess.py to preprocess HarvestingQA dataset, I got many errors in:

https://github.com/ZhangShiyue/QGforQA/blob/master/QG/ELMo_QG/prepare.py#L54

In total, 1189314 examples in HarvestingQA got this error here. I used the train.json of HarvestingQA. How did you cope with this in your experiment? I would appreciate it if you could show the preprocessing procedure in your semi-supervised QA experiment. Thank you very much.

KazutoshiShinoda commented 3 years ago

I found this error was my fault. Sorry for bothering you...