Thank you very much for the tutorial. I am trying to train an XML with (TM) objective on dialectical Arabic, and modern standard Arabic. I use da and ms as the abbreviations for the languages. When I try to run the data.sh to preprocess the data I get this error:
No known abbreviations for language 'da', attempting fall-back to English version...
Is there any parameter that I need to change? I changed the names of the languages to da and ms in the "apply_bpe_preprocess.sh". But still get the error. Thank you for your help
Hi
Thank you very much for the tutorial. I am trying to train an XML with (TM) objective on dialectical Arabic, and modern standard Arabic. I use da and ms as the abbreviations for the languages. When I try to run the data.sh to preprocess the data I get this error:
No known abbreviations for language 'da', attempting fall-back to English version...
Is there any parameter that I need to change? I changed the names of the languages to da and ms in the "apply_bpe_preprocess.sh". But still get the error. Thank you for your help