search

awslabs / decode-answer-logical-form

Other
29 stars 4 forks source link

Absence of `GrailQA/evaluate.py` #1

Closed midannii closed 1 year ago

midannii commented 1 year ago

Hi.

When I run https://github.com/awslabs/decode-answer-logical-form/blob/main/DecAF/Datasets/QA/evaluate.py with the below code, 

cd DecAF-main/DecAF/Datasets/QA
SAVE_DIR='/home/midannii/midannii/DecAF-main/DecAF'
python evaluate.py --dataset GrailQA --result_path ${SAVE_DIR}/Reading/FiD/QA_GrailQA_Freebase_BM25_large_100_p100_b10/final_output_dev_fid_SPQA.json

I face the error that "python: can't open file 'GrailQA/evaluate.py': [Errno 2] No such file or directory" in https://github.com/awslabs/decode-answer-logical-form/blob/main/DecAF/Datasets/QA/evaluate.py#L88

I think evaluate.py should be add in https://github.com/awslabs/decode-answer-logical-form/blob/main/DecAF/Datasets/QA/GrailQA.

PlusRoss commented 1 year ago

Please see the README. You need to download the official evaluate.py and put it in the GrailQA folder.