-
- https://www.aclweb.org/anthology/W18-6319/
- 2018
機械翻訳の分野では、その主要な評価指標であるBLEUスコアの報告に一貫性がないため、あまり認識されていない問題に直面しています。
人々はBLEUスコアを「The」と呼んでいますが、BLEUは実際にはパラメータ化された指標であり、その値はパラメータの変更によって大きく変化します。
その…
e4exp updated
3 years ago
-
As a novice in NLP, I am not well versed in the metrics used in this article. After consulting relevant materials, I have learned that BLEU comes with variations such as BLEU-1, BLEU-2, BLEU-3, and BL…
-
Could you share the code for generating the training data for simcse? What is the difference between text1 and text2 in train_retriever_sup_unsup.json?
-
## This issue is related to commit fbaf82d
After running the script: `bash ./scripts/eval_decoding.sh` , the results came out to be:
corpus BLEU-1 score: 0
corpus BLEU-2 score: 0
corpus BLEU-3 s…
-
- Read the classical papers about BLEU score
- Find the package for the BLEU score (learn from the low-resource machine translation repo)
- Implement a small top dataset for BLEU score
-
Hello. I tried using the demo code of Codi (https://github.com/microsoft/i-Code/tree/main/i-Code-V3) to reproduce results on the AudioCaps dataset. However, I was unable to achieve the results reporte…
-
Thank you for sharing your codes.
I successfully reproduced the BLEU scores on enfr translation with Transformer model by running your command written in `README.md`.
However, I could not reprodu…
-
No, this is not an issue. It's an example for whoever trying to use this package with their own data.
```python
from pycocoevalcap.tokenizer.ptbtokenizer import PTBTokenizer
from pycocoevalcap.b…
-
Currently I am trying to use sentence piece (following the sentence piece tutorial)as the pre-processing procedure to handle English to Japanese translation training. I've tried to use pure sentence p…
-
Hi, How can I evaluate the model on BLEU score? and when training printing accuracy, what is the benchmark that this determines by?
Thanks.