search

bigcode-project / bigcode-evaluation-harness

A framework for the evaluation of autoregressive code generation language models.
Apache License 2.0
709 stars 183 forks source link

Add --save_references_path into args #143

Closed iCSawyer closed 6 months ago

iCSawyer commented 9 months ago

Arguments like --save_generations --save_generations_path --save_references exists, but --save_references_path misses. We can add it and it does not affect existing code.

iCSawyer commented 6 months ago

Hello :) I am new to this and I do not know why this https://github.com/bigcode-project/bigcode-evaluation-harness/actions/runs/6604468842/job/17970522424 failed. I have made few modifications about args. Can you kindly help me review this PR? Thank you~

loubnabnl commented 6 months ago

Adding the argument to the test files fixed the issue, thanks for the PR