-
Thanks for sharing this great work!
Although, I strictly tried to follow the instructions in the ReadMe, I am unable the reproduce the WMT German-English benchmark results on `newstest2015`.
Her…
-
Hi
I have used the authors' WORDMAP and checkpoint files but after running the eval.py on these files with correct filepaths, I received a BLEU-4 score @ beam size of 5 is 0.0606. Do you think I…
-
As far as I know, the basic idea of self-BLEU scores is to calculate the BLEU scores by choosing each sentence in the set of generated sentences as hypothesis and the others as reference, and then tak…
-
### Describe the bug
Hi, I tried to reproduce the result of CVSS speech translation, but I got verty high training loss at around epoch 18. The loss is around 200.
I just follows the instruction …
-
decoding approach --decoding-strategy reparam---。In your experiments, is the default decoding method necessarily worse than the one specified in the script? On different datasets, which decoding meth…
-
https://github.com/apertium/apertium-eval-translator/blob/4dd3e19c647f66af2b42d018bb57e8fb2e875862/bleu.sh#L39
`apertium-eval-translator/` has to be the current working directory for `bleu.sh` to r…
-
Everyone has encountered that every time a reference is added, the bleu score will increase and the sari will decrease. Then when I add all the refs, the bleu score will be very high and the sari will…
-
According the paper for self-bleu calculations each generation is compared against all the **other** references.
The current Self-BLEU implementation includes the selected hypothesis in the list o…
-
Hi!
I am trying to replicate the DiffuSeq model for the Paraphrase task with the QQP dataset. I kept everything to the default training config, and for MBR I ran with 20 different random seeds dur…
-
I am just running the command given in the readme file to train the model on django dataset.
```
. train.sh django
```
I get the below error. I haven't able to able to fix this. Is the somethi…