search

BillChan226 / HALC

[ICML 2024] Official implementation for "HALC: Object Hallucination Reduction via Adaptive Focal-Contrast Decoding"
https://billchan226.github.io/HALC
MIT License
54 stars 1 forks source link

ERROR in evaluation CHAIR. #8

Open ZaneKan0 opened 1 month ago

ZaneKan0 commented 1 month ago

Thanks for your great work! But I got error when I ran evaluation of CHAIR.

I used 'run_scripts/caption_generation.py' to get a json file in the following format.

image

When I used 'eval/eval_hallucination.py' to test it, I got the following error.

image

How can I solve it? Thanks a lot!

XixiLiu95 commented 2 days ago

Hi,

You might need to firstly generate the corresponding _chair.json file by doing 

python eval/caption_to_chair.py -c [PATH_TO_CAPTION_FOLDER_DIR]

The path of the generated file should be passed to --chair_input_path. By doing this, it should work. However, I did not obtain similar results to the ones reported. Let me know if that works for you! If yes, did you get similar results? Thanks!