Thank you very much for being able to open source this code. However, this code cannot run successfully. The member parameters of some classes in the code are undefined, for example: self.use_faiss_centroids of TransformerDecoderBase, etc.
in scoring/tokenizer.py:
from sacrebleu.tokenizers import TOKENIZERS
which TOKENIZERS is not defined, it must added to /relatedPATH/site-packages/sacrebleu/tokenizers/init.py with
Thank you very much for being able to open source this code. However, this code cannot run successfully. The member parameters of some classes in the code are undefined, for example: self.use_faiss_centroids of TransformerDecoderBase, etc.
in scoring/tokenizer.py: from sacrebleu.tokenizers import TOKENIZERS which TOKENIZERS is not defined, it must added to /relatedPATH/site-packages/sacrebleu/tokenizers/init.py with