Check anonymised version of DCHG corpus for character issues

jbrry / Irish-BERT

Repository to store helper scripts for creating an Irish BERT model.

Other

9 stars 0 forks source link

Check anonymised version of DCHG corpus for character issues #60

Open jowagner opened 3 years ago

jowagner commented 3 years ago

Seamus observed an issues with the parallel version of the anonymised DCHG corpus when training an MT system. Investigate whether the Irish side is ok for our purposes.