search

JudePark96 / BERT-KorQuAD-Competition

Machine Reading Comprehension Competition w/ Korean BERT Model
5 stars 2 forks source link

Experiment Result #3

Open JudePark96 opened 4 years ago

JudePark96 commented 4 years ago

https://github.com/enlipleai/korquad-challenge 의 baseline

{"exact_match":** 78.6802909594735, "f1": 88.19766039994913}

JudePark96 commented 4 years ago

Post-Training

{"exact_match": 78.90543817111188, "f1": 88.68283891914339}

EM 은 .225147212 상승하였고 F1 은 .485178519 상승하였다.

JudePark96 commented 4 years ago

Post-Training + MaxPool1d

{"exact_match": 79.06130931763076, "f1": 88.92726198962508}

JudePark96 commented 4 years ago

그전까지의 Post-Training 은 MLM (max_seq_len: 192) 진행했다.

Post-Training (MLM + NSP (max_seq_len: 256)) + MaxPool1d

{"exact_match": 79.25181849670939, "f1": 89.14162534975335}

baseline 에 비해 EM 은 .571527537, F1 은 .94396495 올랐다