bigcode-project / bigcode-evaluation-harness

A framework for the evaluation of autoregressive code generation language models.
Apache License 2.0
781 stars 208 forks source link

To evaluate Github copilot? #195

Open liw8hz opened 8 months ago

liw8hz commented 8 months ago

Is any possible to evaluate Github copilot? Better to get a good reference of open coder module with closed coder module : )