Open niansong1996 opened 1 year ago
For CodeContest's requirement, unable to install bazel on the server. It uses apt install.
Also working on preprocessing DS-1000 into jsonl file
Assigning this also to @yilunzhao for CodeContest
We are adding DS-1000 in #44 and HumanEval in #51
We would like to add more general code generation datasets for evaluation:
Though we already have Python program executors, we still need to adapt to some of the new datasets.