abhimishra91 / transformers-tutorials

Github repo with tutorials to fine tune transformers for diff NLP tasks
MIT License
822 stars 193 forks source link

Fine-tuning MarianMT for Machine Translation tasks #5

Open kr-sundaram opened 4 years ago

kr-sundaram commented 4 years ago

Hi, I am new to the field of NLP. I wanna do the fine-tuning of MarianMT pretrained models for deutsch to english translation. But, i am not sure how to achieve that. I checked the MarianMT, they uses BART for their model architecture configuration, but they dont share any information on how to fine-tune the model or train the model form scratch.

abhimishra91 commented 4 years ago

Hi @kr-sundaram, i have not looked into this use case yet. But i will definitely add it to my list of NLP tasks. Alternatively, you can also look at T5 to be fine tuned for translation task.