-
I have two questions:
1. How do you compute the reported BLEU scores? I see the imports of BLEU in several models but BLEU is never added to the `self.metrics` collection of any of them.
2. When…
-
-
When i run the inference with the trained model with the evaluation ,the train and the test set i get the following BLEU-4 scores
Train set: 2.0
Dev set: 8.4
Test set: 9.3
How is that possible to…
-
I am running under Windows 10, but I found that the bleu score is not running, why?
-
The model was trained on flicker8k, but the results achieved only half the BLEU-4 score mentioned by the authors (about 0.14-0.15). I have not modified any parameters in train.py. May I ask why such a…
-
Why do I only get a CIDEr score of 0.065 on Flickr30k for bliva_vicuna7b, even if multiplied by 10 it's only 0.65? Could you tell me what might have gone wrong in this process?? Thanks.
{"test": {"Bl…
-
On Running the example given in the code, I am receiving the following error:
Seems some issue with not able to find a java library:
```bash
Reasons: [no lmdbjni64-0.4.6 in java.library.path, no l…
-
Thank you for the dataset.
I am very novice at NMT, the tensor2tensor's bleu score differs from that obtained by using the 'multi-bleu.perl'. Example t2t-bleu reports: 28.13 (uncase), 27.391 (cased…
-
Hi Bsantraigi
You have provided great tutorials. I saw your transliteration.ipynb.
In this, in Input cell "In[37]", you have put the line 'pbar.set_description(f"Epoch: {_e} >> Loss: {batch_loss/(bx…
-
Hi,
I've just found that the calculation of BLEU score during the training is incorrect.
Current implementation of evaluateBLEU function in train.cc,
just compare hypothesis and target word IDs,…