[BERT] BERT QA Enhancements

dmlc / gluon-nlp

NLP made easy

https://nlp.gluon.ai/

Apache License 2.0

2.56k stars 535 forks source link

Open eric-haibin-lin opened 5 years ago

eric-haibin-lin commented 5 years ago

Thanks to @fierceX we now have an fine-tuning example of BERT for SQuAD 1.1. https://github.com/dmlc/gluon-nlp/pull/493

Followup works:

[ ] Tutorial for fine-tuning on SQuAD 1.1. The QA dataset pre-processing is more complicated than the classification example and deserves more description.
[ ] improve SQuAD 1.1 with extra fine-tuning epochs on TriviaQA dataset
[ ] reproduce result on SQuAD 2.0
[ ] example for finetuning BERT for other QA datasets

eric-haibin-lin commented 5 years ago

Would you be interested to make some enhancement for BERT+QA for gluonnlp? @zhiheng-huang