issues
search
amazon-science
/
cceval
CrossCodeEval: A Diverse and Multilingual Benchmark for Cross-File Code Completion (NeurIPS 2023)
https://crosscodeeval.github.io/
Apache License 2.0
115
stars
17
forks
source link
Improve evaluation experience
#20
Closed
zijwang
closed
7 months ago
zijwang
commented
7 months ago
Disentangle generation and metrics calculation
vLLM-based inference to improve efficiency
latest OpenAI inference
new README