search

peteanderson80 / SPICE

Semantic Propositional Image Caption Evaluation
http://panderson.me/spice
GNU Affero General Public License v3.0
132 stars 31 forks source link

SPICE on another language? #13

Open jontooy opened 2 years ago

jontooy commented 2 years ago

Hi all!

I want to do SPICE evaluation on Arabic Captions specifically. In the 'spice-1.0.jar' file there is a README file that says:

Dependencies

Since the the version of Stanford CoreNLP is not compatible with Arabic, I wonder if I can:

  1. Replace Stanford Scene Graph Parser with the latest version, updated to work with CoreNLP 4.2.0
  2. Replace CoreNLP 3.6.0 with 4.2.0 with Arabic models

I actually tried to download and replace these files in the COCO-caption API, but with no improved SPICE scores...

Do you think this task is possible or no?