search

RitaRamo / smallcap

SmallCap: Lightweight Image Captioning Prompted with Retrieval Augmentation
94 stars 20 forks source link

problems encountered when evaluating SPICE #11

Closed DingchenYang99 closed 11 months ago

DingchenYang99 commented 1 year ago

sorry if this is caused by stupid reasons, I am new to Java language I encountered the following problem when commanding 'python /smallcap/caption/dramaEvalCap.py'

tokenization... PTBTokenizer tokenized 23639 tokens at 411834.08 tokens per second. PTBTokenizer tokenized 47091 tokens at 630900.25 tokens per second. setting up scorers... computing Bleu score... {'testlen': 44550, 'reflen': 21080, 'guess': [44550, 42008, 39466, 36925], 'correct': [5332, 1242, 258, 99]} ratio:2.113378 Bleu_1: 11.97 Bleu_2: 5.95 Bleu_3: 2.85 Bleu_4: 1.58 computing METEOR score... METEOR: 9.98 computing CIDEr score... CIDEr: 11.78 computing SPICE score... Exception in thread "main" java.lang.NoClassDefFoundError: com/google/common/base/Stopwatch at edu.anu.spice.SpiceScorer.scoreBatch(SpiceScorer.java:69) at edu.anu.spice.SpiceScorer.main(SpiceScorer.java:60) Caused by: java.lang.ClassNotFoundException: com.google.common.base.Stopwatch at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:355) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) ... 2 more Traceback (most recent call last): File "/home/lufan/Projects/smallcap/caption/dramaEvalCap.py", line 38, in dramaEval.evaluate() File "/home/lufan/Projects/smallcap/caption/pycocoevalcap/eval_drama.py", line 56, in evaluate score, scores = scorer.compute_score(gts, res) File "/home/lufan/Projects/smallcap/caption/pycocoevalcap/spice/spice.py", line 70, in compute_score subprocess.check_call(spice_cmd, File "/home/lufan/miniconda3/envs/smallcap/lib/python3.9/subprocess.py", line 373, in check_call raise CalledProcessError(retcode, cmd) subprocess.CalledProcessError: Command '['/home/lufan/java/jdk1.8.0_371/bin/java', '-jar', '-Xmx8G', '/home/lufan/Projects/smallcap/caption/pycocoevalcap/spice/spice-1.0.jar', '/home/lufan/Projects/smallcap/caption/pycocoevalcap/spice/tmp/tmpiai6r6_r', '-out', '/home/lufan/Projects/smallcap/caption/pycocoevalcap/spice/tmp/tmpxbfagpuw', '-subset', '-silent']' returned non-zero exit status 1.

It seemed that guava.jar is not recognized. Would you help, please?

DingchenYang99 commented 1 year ago

the script dramaEvalCap.py is exactly the same as smallcap/caption/cocoEvalCapDemo.ipynb, with modification to my data only.

tuyunbin commented 6 months ago

How did you solve this problem?

DingchenYang99 commented 6 months ago

I failed to install all java dependencies.