QuestionAnsweringタスク

[trtd56]

前回のコンペ

• https://www.kaggle.com/c/chaii-hindi-and-tamil-question-answering/discussion/264358

[trtd56]

参考になりそうな記事

• https://www.kaggle.com/c/chaii-hindi-and-tamil-question-answering/discussion/264493

[trtd56]

タミル語論文

• https://www.kaggle.com/c/chaii-hindi-and-tamil-question-answering/discussion/264691

ヒンディー語論文

• https://www.kaggle.com/c/chaii-hindi-and-tamil-question-answering/discussion/264690

多言語

• https://www.kaggle.com/c/chaii-hindi-and-tamil-question-answering/discussion/264695

[trtd56]

BERT Based Multilingual Machine Comprehension in English and Hindi

• mBERTにSQuAD2を学習させたZero-Shot
• HIndiで学習させたmono
• 多言語で学習させたcross

の比較

パラメータ

Lower the case for input: False
Max (sequence, query, answer) length: 384, 64, 30
Train, predict batch sizes: 12,8
Learning rate, warmup proportion: 5e-5, 0.1
Number of epochs: 3.0

[trtd56]

過去コンペ https://www.kaggle.com/c/chaii-hindi-and-tamil-question-answering/discussion/264358