ntunlp / xCodeEval

xCodeEval: A Large Scale Multilingual Multitask Benchmark for Code Understanding, Generation, Translation and Retrieval
MIT License
74 stars 6 forks source link

Dataset Release #1

Closed wangwenhaoxiaotie closed 1 year ago

wangwenhaoxiaotie commented 1 year ago

Hello, When will you plan to release the dataset? thank you!

sbmaruf commented 1 year ago

Within a few hours. :heart:

wangwenhaoxiaotie commented 1 year ago

Thank you!

aksh555 commented 1 year ago

Hi, has the dataset for Program Synthesis been released? Thanks!

sbmaruf commented 1 year ago

Hi! @aksh555 Thanks for informing us that you didn't find the "Program Synthesis" data in the repo. Earlier we already uploaded all the data in the huggingface repo but didn't update the proper documentation in the xCodeEval Repo. Now that we have updated the proper documentation here, feel free to go ahead and see if you can figure out where is the "Program Synthesis" and how to get that. Do let us know if you find any broken links, anything confusing, or if any instruction is not working. If you still can't find the data, here is the link of the program synthesis doc, https://github.com/ntunlp/xCodeEval/blob/main/program_synthesis.md

sbmaruf commented 1 year ago

Closing the issue. Please open it if you have any more query.