search

jbrry / Irish-BERT

Repository to store helper scripts for creating an Irish BERT model.
Other
9 stars 0 forks source link

Is XPOS prediction task in fine-tuning confusing the model? #75

Open jowagner opened 3 years ago

jowagner commented 3 years ago

See whether LAS and other metrics are more consistent over multiple runs when XPOS prediction is removed from the list of tasks in the multi-task parser.

jowagner commented 3 years ago

Teresa says the XPOS tags in the treebank are reliable and information in XPOS is mostly covered by morphological features.

Still possible that having XPOS as a task in multi-task training of the parser is not helpful.

Jennifer suggests to leave them in.