bigcode-project / bigcode-evaluation-harness

A framework for the evaluation of autoregressive code generation language models.
Apache License 2.0
825 stars 219 forks source link

To evaluate Github copilot? #195

Open liw8hz opened 9 months ago

liw8hz commented 9 months ago

Is any possible to evaluate Github copilot? Better to get a good reference of open coder module with closed coder module : )