ShannonAI / fast-knn-nmt

Apache License 2.0
32 stars 4 forks source link

Which fairseq files are used? #4

Closed SirRob1997 closed 2 years ago

SirRob1997 commented 2 years ago

In the repo we have fairseq files in fast-knn-nmt/fast_knn_nmt/custom_fairseq/ as well as fast-knn-nmt/thirdparty/fairseq/ the files/changes to, for example, the sequence_scorer.py differ in these two. Which one is the correct one to use and why do the other ones exist?

YuxianMeng commented 2 years ago

@SirRob1997 Sorry for the confusion. The files in third_party is mainly used to extract features, and the files in custom_fairseq are codes that used for other purposes like computing ppl or bleu. Both of them are modified a little bit to serve their own purpose.

SirRob1997 commented 2 years ago

Got it, might be worth mentioning that somewhere in the Readme. Thanks!