search

CZWin32768 / XNLG

AAAI-20 paper: Cross-Lingual Natural Language Generation via Pre-Training
https://arxiv.org/abs/1909.10481
128 stars 16 forks source link

is it related to UniLM ? #2

Closed Neuronys closed 4 years ago

Neuronys commented 4 years ago

Hi I've notice some name in common between the 2 papers (https://arxiv.org/pdf/1905.03197.pdf and https://arxiv.org/pdf/1909.10481v3.pdf). How these 2 projects are related ? Thanks and congrats for such an impressive work ! Philippe

CZWin32768 commented 4 years ago

Both XNLG and UniLM are pre-trained models for NLG tasks. UniLM is designed for monolingual NLG, while XNLG focuses on transferring NLG supervision signals from a language to another language. For example, fine-tuned with English abstractive summarization data, XNLG can directly perform summarization on French data.