facebookresearch / MUSE

A library for Multilingual Unsupervised or Supervised word Embeddings
Other
3.19k stars 552 forks source link

EN-EO dictionary #34

Closed ccsasuke closed 6 years ago

ccsasuke commented 6 years ago

Hi,

It seems I could not find the EN-EO dictionary in the list of released dictionaries to reproduce Table 1 results. Are the Esperanto dictionaries released?

Thanks.

aconneau commented 6 years ago

Hi,

here are the

EN-EO dictionaries: https://s3.amazonaws.com/arrival/dictionaries/en-eo.0-5000.txt https://s3.amazonaws.com/arrival/dictionaries/en-eo.5000-6500.txt

EO-EN dictionaries: https://s3.amazonaws.com/arrival/dictionaries/eo-en.0-5000.txt https://s3.amazonaws.com/arrival/dictionaries/eo-en.5000-6500.txt

We'll add it to the list of dictionaries. Thanks for flagging this. Best, Alexis

xiaoleihuang commented 6 years ago

@aconneau Hi, could you also explain the differences between 0-5000.txt and 5000-6500.txt? Thanks!

glample commented 6 years ago

The first is the training set, the second is used for evaluation.

KamenBrestnichki commented 5 years ago

Hi @aconneau,

Thank you for open-sourcing all the dictionaries. The links to the EN-EO dictionaries don't seem to work anymore and are not included in the get_evaluation.sh bash script. Are they available at another place?

Best wishes, Kamen

glample commented 5 years ago

Hi,

Can you try this link? https://dl.fbaipublicfiles.com/arrival/dictionaries.tar.gz

KamenBrestnichki commented 5 years ago

Hi Guillaume,

Thank you for getting back to me so swiftly! The link works, but unfortunately the En-Eo dictionary doesn't seem to be present among the dictionaries in that archive. Do you have an idea of where that could be available?

Thanks, Kamen

glample commented 5 years ago

Mmm if this is not there I really don't know, that was a long time ago and I think we found some small dictionary online, I can't remember :/

KamenBrestnichki commented 5 years ago

Hey Guillaume,

Thank you for your time! If you happen to remember, please let me know.

Best, Kamen