nuprl / MultiPL-E

A multi-programming language benchmark for LLMs
https://nuprl.github.io/MultiPL-E/
Other
200 stars 38 forks source link

Adding C language to MultiPL-E #151

Closed 49Simon closed 3 months ago

49Simon commented 3 months ago

Hi, I am interested in evaluating code models in C language. C++ is already included and I'm wondering if you tried to add C to the MultiPL-E framework? Do you have plans of adding it in the near future?

Thanks

arjunguha commented 3 months ago

Thanks for your interest. This is not something we plan to do, but we would welcome a contribution.