PANXiao1994 / mRASP2

120 stars 25 forks source link

Dataset for evaluation #30

Open NinaadRao opened 1 year ago

NinaadRao commented 1 year ago

Hi there, I have been trying to use the mRASP2 model for evaluation and have run into a couple of issues.

  1. The sample yaml file for evaluation has the following format: data_testset_1: direction: en2de name: wmt14 path: data/binarized/en_de/en2de/wmt14 ref: data/dev/en2de/wmt14

What are the path and ref referring to? How do we get the binarized version? Is there a script that I can follow or a link to the dataset that was used.

Additionally, what is the fairseq model used while evaluating?