facebookresearch / XLM

PyTorch original implementation of Cross-lingual Language Model Pretraining.
Other
2.87k stars 495 forks source link

How to use xlm for code-mixed language embedding? #265

Open Monica9502 opened 4 years ago

Monica9502 commented 4 years ago

As mentioned, i'm trying to use xlm model for english and hindi mixed data,so does it work like https://github.com/facebookresearch/XLM/blob/master/generate-embeddings.ipynb show? Then i'm gonna use the embeddings for sentiment classification like SST-2, therefore I think models can be fine tune based on my task, is that right? Thanks!