ntunlp / xCodeEval

xCodeEval: A Large Scale Multilingual Multitask Benchmark for Code Understanding, Generation, Translation and Retrieval
MIT License
74 stars 6 forks source link

Prompts? #12

Open yazdanbakhsh opened 2 months ago

yazdanbakhsh commented 2 months ago

Can you please release the prompts you used for the code translation task?

Jackal1586 commented 2 months ago

Please find the prompts and generation code for all generative tasks: https://github.com/ntunlp/xCodeEval/pull/8.

sbmaruf commented 2 months ago

Regarding the data loading issue mentioned in this discussion: https://huggingface.co/datasets/NTU-NLP-sg/xCodeEval/discussions/2,

We've identified that the problem is related to the version of the datasets library you're using. Please make sure to use the specific version of the package listed in our requirements.txt file here: https://github.com/ntunlp/xCodeEval/blob/main/requirement.txt#L17.

This should resolve the issue.