amazon-science / mm-cot

Official implementation for "Multimodal Chain-of-Thought Reasoning in Language Models" (stay tuned and more will be updated)
https://arxiv.org/abs/2302.00923
Apache License 2.0
3.77k stars 309 forks source link

KeyError: 'true_false' #36

Open zcy1234321 opened 1 year ago

zcy1234321 commented 1 year ago

** CUDA_VISIBLE_DEVICES=0,1 python main.py \ --model allenai/unifiedqa-t5-base \ --user_msg rationale --img_type detr \ --bs 4 --eval_bs 2 --eval_acc 10 --output_len 512 \ --final_eval --prompt_format QCM-LE

When running the above code, an error is reported, please ask which part of the data true_false in**

_Traceback (most recent call last): File "/environment/miniconda3/lib/python3.7/site-packages/pandas/core/indexes/base.py", line 3361, in get_loc return self._engine.get_loc(casted_key) File "pandas/_libs/index.pyx", line 76, in pandas._libs.index.IndexEngine.get_loc File "pandas/_libs/index.pyx", line 108, in pandas._libs.index.IndexEngine.get_loc File "pandas/_libs/hashtable_class_helper.pxi", line 5198, in pandas._libs.hashtable.PyObjectHashTable.get_item File "pandas/_libs/hashtable_class_helper.pxi", line 5206, in pandas._libs.hashtable.PyObjectHashTable.get_item KeyError: 'true_false'

The above exception was the direct cause of the following exception:

Traceback (most recent call last): File "main.py", line 381, in args = args File "main.py", line 312, in T5Trainer scores = get_scores(results_ans, results_rationale, results_reference, os.path.join(args.data_root, "scienceqa/problems.json")) File "/home/featurize/work/mm-cot/mm-cot-main/utils_evaluate.py", line 54, in get_scores print(res_pd['true_false']) File "/environment/miniconda3/lib/python3.7/site-packages/pandas/core/frame.py", line 3458, in getitem indexer = self.columns.get_loc(key) File "/environment/miniconda3/lib/python3.7/site-packages/pandas/core/indexes/base.py", line 3363, in get_loc raise KeyError(key) from err KeyError: 'truefalse'

zcy1234321 commented 1 year ago

image

cashmere0 commented 1 year ago

same problem with u. may I ask do u solve it now?thank u!