fix: rust timeout exception

bigcode-project / bigcode-evaluation-harness

A framework for the evaluation of autoregressive code generation language models.

Apache License 2.0

698 stars 180 forks source link

Closed seobeomjin closed 1 week ago

seobeomjin commented 1 month ago

While evaluating the humanevalpack-rust, it was unable to proceed with the evaluation due to a timeout error from subprocess execution.
This PR applies the try-except statement to handle subprocess.TimeoutExpired in the rust execution function. If you think it would be better to commit this to code_eval_octopack, you can close this PR :)

Muennighoff commented 1 week ago

Thanks a lot! Yes could you open a PR on the Hugging Face space instead? That'd be amazing 🙌