seketeam / EvoCodeBench

An Evolving Code Generation Benchmark Aligned with Real-world Code Repositories
Apache License 2.0
31 stars 2 forks source link

Running recall@1 for baseline KeyError: 'generated_dependency' #8

Open pldlgb opened 1 month ago

pldlgb commented 1 month ago

Running recall@1 for baseline post-codeqwen TODO Completions: 201

100%|███████████████████████████████████████████████████████████████████████████████████████████████| 201/201 [17:38<00:00, 5.27s/it] Traceback (most recent call last): File "/mnt/intern/QwenEval/EvoCodeBench/parser/recall_k.py", line 229, in main() File "/mnt/intern/QwenEval/EvoCodeBench/parser/recall_k.py", line 225, in main report_results(args, k_list, output_data, benchmark_data) File "/mnt/intern/QwenEval/EvoCodeBench/parser/recall_k.py", line 56, in report_results parse_results[namespace][completion] = js['generated_dependency'] KeyError: 'generated_dependency'