bigcode-project / bigcode-evaluation-harness

A framework for the evaluation of autoregressive code generation language models.
Apache License 2.0
776 stars 201 forks source link

Add CodeXGLUE-text-to-text benchmark for documentation translation #3

Closed loubnabnl closed 1 year ago

loubnabnl commented 1 year ago

Add this benchmark for documentation translation to the evaluation harness: https://huggingface.co/datasets/code_x_glue_tt_text_to_text

infinitylogesh commented 1 year ago

Hi, I am interested in taking this up !

loubnabnl commented 1 year ago

Great, let us know if you need any help!