-
Hi seanie!
Really appreciate for your code share, it does help me deepen my understanding of this paper.
But I have some trouble reproducing your code in the inference stage.
After inference stage…
-
r1 = rouge_score[0]["rouge-1"]['r']
r2 = rouge_score[0]["rouge-2"]['r']
rl = rouge_score[0]["rouge-l"]['r']
b1 = sentence_bleu(reference, candidate, weights=(1, 0, 0…
-
Dear authors,
I understand that you plan to release your code on January. But could you share more details regarding how you evaluate the BLEU score and PPL on the LM1B dataset? I am also working o…
-
Hi,
I couldn't find a way in the code to reproduce the BLEU score of 38.97 you published in your paper on the test set of WikiSQL.
Can you please instruct me on how to reproduce it?
Thanks.
-
I am attempting to compute chrF++ for a set of predictions and references. If I use `sacrebleu` cli (`sacrebleu ref.eng_Latn.tok < pred.eng_Latn.tok -m bleu chrf --chrf-word-order 2`), I find a signif…
-
Hi, I am trying to do urdu transliterate like converting roman urdu to urdu font.
In 10 epochs, i got 88 bleu score.
Despite the good score, the results are bad.
Is there a way to add [ngram LM …
-
## ❓ BLEU score calculation
### Before asking:
1. search the issues.
2. search the docs.
#### What is your question?
Hi, I am wondering how does fairseq get bleu score when passing `--sco…
-
Hey,
I downloaded your notebook and pretrained weights and wasn't able to reproduce the BLEU scores you obtained. These are the BLEU scores I got:
`
[('100-1', 2.2396683846707894e-155), ('1000-1…
-
Hi, I was able to reproduce the GLUE benchmark results but not the NLG task.
For NLG tasks, I downloaded the checkpoint for GPT2-M and follow the step 2,3,4 in the instructions
https://github.c…
-
In burn-train, several metrics can be used during training. It would be great to have more!
- [X] Accuracy
- [X] Loss (the one in use)
- [X] CUDA utilization (memory&compute)
- [x] Top-k accurac…