issues
search
amazon-science
/
cceval
CrossCodeEval: A Diverse and Multilingual Benchmark for Cross-File Code Completion (NeurIPS 2023)
https://crosscodeeval.github.io/
Apache License 2.0
115
stars
17
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Do you have a C++ testing set?
#23
czq99972
opened
1 month ago
0
Where is the code for static analysis?
#22
ramsey-coding
opened
3 months ago
2
How do I specify different Settings in the code generation script? baseline, retrieval, retrieval w/ ref
#21
kartikzheng
opened
4 months ago
1
Improve evaluation experience
#20
zijwang
closed
7 months ago
0
opensource-codeofconduct@amazon.com is the email for getting raw repo data?
#19
yiyepiaoling0715
closed
8 months ago
1
Tokenizer used for BM25
#18
AaboutL
closed
8 months ago
1
Bump transformers from 4.29.2 to 4.36.0
#17
dependabot[bot]
closed
6 months ago
1
Adding scripts for CCEval prompt crafting for RAG experiments
#16
wasiahmad
closed
8 months ago
1
Update OpenAI inference script for compatibility with evaluation
#15
nihaljn
closed
8 months ago
0
Retriever performance evaluation
#14
bsobolev
closed
10 months ago
3
Regarding relevant data to benchmark the performance of the retriever
#13
anmolagarwal999
closed
10 months ago
1
It seems only python tree-sitter is used.
#12
starlitsky2010
closed
11 months ago
2
Supporting deepseek coder
#11
ganler
closed
11 months ago
1
I can't reproduce the benchmark results in the paper for the model codegen-350
#10
starlitsky2010
closed
11 months ago
9
Is current crossfile_context provided correctly?
#9
leiwen83
closed
10 months ago
2
Raw code projects of the curated data
#8
ganler
closed
11 months ago
1
Is the maximum sequence length of CodeGen2.5 really 4,096?
#7
njuweicheng
closed
11 months ago
2
Add OpenAI inference script
#6
nihaljn
closed
11 months ago
1
Is there a way to reproduce the gpt-3.5-turbo results with this repo?
#5
madhavatreplit
closed
11 months ago
11
The model can complete even if it only sees the contents of the input file
#4
18liumin
closed
10 months ago
2
how to implement the RG approach?
#3
18liumin
closed
11 months ago
1
How is the data set collected? Can you provide some code?
#2
18liumin
closed
11 months ago
4
Bump transformers from 4.29.2 to 4.30.0
#1
dependabot[bot]
closed
11 months ago
1