bleu error

[b10112157]

i use captions_val2014.json，but bleu value wrong . how to solve it.?

gts = tokenizer.tokenize(gts) i try "print (gts) in eval.py",but show the {458755: ['']} my equip is py 3.5.4,and tf 1.4.0

[salaniz]

Can you please try to run the example from the original repository https://github.com/tylin/coco-caption, namely by getting:

• annotations/captions_val2014.json
• results/captions_val2014_fakecap_results.json

and then running the provided notebook: cocoEvalCapDemo.ipynb

Does the code work then? Maybe your results.json is not in the correct format?

[b10112157]

ok ，i can try it . my python is py3.5. the project can run the py35?

[b10112157]

sorry i run this project . but get some error. how to solve it the problem?

[salaniz]

You have to use the current project for Python 3 support not the original one.

So you have to do the following on a clean directory:

• clone and install https://github.com/cocodataset/cocoapi (find the instructions in the readme and make sure you can run 'import pycocotools' afterwards)
• clone this repository (https://github.com/salaniz/pycocoevalcap), you should be able to run 'import pycocoevalcap' now
• copy the files annotations/captions_val2014.json and results/captions_val2014_fakecap_results.json from https://github.com/tylin/coco-caption (do not clone the whole repository)
• from the same directory, see if you can run this code:

from pycocotools.coco import COCO
from pycocoevalcap.eval import COCOEvalCap

dataDir = '.'
dataType = 'val2014'
algName = 'fakecap'
annFile = '%s/annotations/captions_%s.json'%(dataDir,dataType)
resFile = '%s/results/captions_%s_%s_results.json'%(dataDir,dataType,algName)

coco = COCO(annFile)
cocoRes = coco.loadRes(resFile)

cocoEval = COCOEvalCap(coco, cocoRes)
cocoEval.params['image_id'] = cocoRes.getImgIds()

cocoEval.evaluate()

[b10112157]

in the step 1: command line in cocoapi/pythonAPI "python setup.py build_ext --inplace" and "python setup.py build_ext install" Is it the correct procedure? but show output that

[salaniz]

I seems like you don’t have a C++ compiler installed or it's not in your PATH environment variable because the error comes from not finding cl.exe.

[b10112157]

i command python setup.py install now it can "import pycocotools " in the step 2, i put the bleu、cider 、metor 、rough、tokenizer 、eval.py .in the folder pycocoevalcap. and clone "\annotations\captions_val2014.json" and "\results\captions_val2014_fakecap_results.json"

and run this code but show that .

[b10112157]

thanks i already use it , i forget install java

[salaniz]

Then I assume the issue is resolved.