facebookresearch / MUSE

A library for Multilingual Unsupervised or Supervised word Embeddings
Other
3.17k stars 544 forks source link

New languages #169

Open sophiakene opened 4 years ago

sophiakene commented 4 years ago

Hello, Is it possible to use MUSE for completely "new" languages? I am trying to use it for two sign languages and I do not have dictionaries, so I would like to use the unsupervised method. However, if I don't specify the source and target language using --src_lang and --tgt_lang respectively, the languages are set to English and Spanish by default. Is there a workaround to not specify the languages? If I execute it anyway, after ca. 2h of running it throws the following error:

python3 supervised.py --src_emb ../fastText-0.9.1/sign_lang1.bin --tgt_emb ../fastText-0.9.1/sign_lang2.bin --cuda False --emb_dim 100 :
RuntimeError: invalid argument 1: tensor must have one dimension at /pytorch/aten/src/TH/generic/THTensorEvenMoreMath.cpp:592

I would be very thankful for any help! Cheers, Sophia