-
Thank u for your grand project. It really helps a lot. But now I'm in trouble evaluating the task-specific motionGPT to tackle with motion translation. It seems that when the model is training on m2t …
-
Hi,
I am running the machine translation examples, however the best BLEU score reported is 7.71 with more than 400000 iterations' training. However the paper `neural machine translation by jointly le…
-
I encountered the same issue with [issue 1382](https://github.com/microsoft/unilm/issues/1382) when I downloaded the checkpoint from Beit-3's GitHub repository, but I couldn't achieve the performance …
-
def compute_score(self, gts, res):
assert(gts.keys() == res.keys())
imgIds = gts.keys()
bleu_scorer = BleuScorer(n=self._n)
for id in imgIds:
…
-
Hey authors,
Can y'all share the annotation json for clothov2 evaluation.
-
Hi,
First of all, thanks for the great work!
### Issue I encountered:
I am trying to replicate the BLIP-2 paper, Table3,
![Screenshot 2024-05-29 at 23 36 23](https://github.com/salesforce/LAV…
-
## My env :
2 NVIDA GeForce RTX 2080 Ti
pytorch 1.5.0
## Data source : http://www.statmt.org/wmt17/translation-task.html
include "News Commentary v12" and "UN Parallel Corpus V1.0"
## Data…
-
Hi
I was able to train the model.
When I try to evaluate the model using the command, I get this following error. How do I overcome this ?
(pytG) Power-Ubuntu-18-9:~/im2latex-master$ python e…
-
Hi, I evaluate the pre-trained model , but the scores are as following:
ratio: 0.996517511006
Bleu_1: 0.639
Bleu_2: 0.455
Bleu_3: 0.317
Bleu_4: 0.222
computing METEOR score...
METEOR: 0.202
computing…
-
I'm currently using the pycocoevalcap package to evaluate the performance of my image captioning model. I've noticed that the CIDEr score is consistently 0 for all of my model's generated captions, wh…