Could not Find Key File prestore_dev_result.py

[MPX0222]

When I tried to finetune T5-series models following the introduction of BIRD-Benchmark, I got the error in the evaluation process. I found the error occured by ./metrics/bird/evaluator.py line 16: pre_results = pickle.load(open('./bird/dev_result.bin', 'rb')). However, I found this bin file should be generated by ./run/run_dev_exec.sh and ./bird/prestore_dev_result.py. I could not find this python file in the project or third_party folder. could you help me to fix this problems?

Thank for your reading.

[Cointnt]

Cartoon animation

[Cointnt]

Cartoon animation

[accpatrick]

@MPX0222 Thanks for your interests in our work! Sorry for this issue. Actually, we wrote this just for faster evaluation since some databases are big. You could directly execute it and store it as pickle file and reuse it in the following evaluation or iteration. Thanks

[MPX0222]

@accpatrick Thanks for your reply. However, do you mean I should execute run_dev_exec.sh ? That is what error happened. In the line 10 of this sh file: python3 -u ./bird/prestore_dev_result.py --ground_truth_sqls ${ground_truth_sqls} --db_path ${db_path} --num_cpus ${num_cpus} --result_save_path ${result_save_path}. The key python file ./bird/prestore_dev_result.py is not included in this repo. Could you tell me how to fix this?

[Gxyrious]

same problem