facebookresearch / MUSE

A library for Multilingual Unsupervised or Supervised word Embeddings
Other
3.18k stars 552 forks source link

Does it make sense to run the adversarial training on the already-aligned vector spaces? #49

Closed bdqnghi closed 6 years ago

bdqnghi commented 6 years ago

Supposed that I have already achieved the aligned vector spaces from another approach rather than MUSE, does it make sense to run those already-aligned vector spaces again on the adversarial training proposed in MUSE? Will it make the vector spaces to be more aligned? which can produce better results.

glample commented 6 years ago

Yes you can do this. But in your case you can directly start with the refinement procedure. It is much faster, and works better, as long as there is an initial embedding alignment that allows to get a reasonable accuracy. For instance, on English-French, starting the refinement from an adversarial alignment that gives 30% or 60% will end up giving the same final accuracy of around 80% P@1.

bdqnghi commented 6 years ago

i see, thanks