princeton-nlp / intercode

[NeurIPS 2023 D&B] Code repository for InterCode benchmark https://arxiv.org/abs/2306.14898
https://intercode-benchmark.github.io/
MIT License
194 stars 32 forks source link

Update prompts.py #5

Closed fengsxy closed 1 year ago

fengsxy commented 1 year ago

While i am reproducing the experiment, i find the most errors are about ls testbed/ instead of execute[ls testbed], it will affect experiment result, pay attention on it!