issues
search
FudanSELab
/
ClassEval
Benchmark ClassEval for class-level code generation.
MIT License
108
stars
5
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
ClassEval_2 wrong test case and function description
#11
doomspec
opened
2 days ago
0
Wrong skeleton in ClassEval_17
#10
doomspec
opened
6 days ago
0
Pass@1 greedy results are changing whenever I re-evaluate
#9
sfc-gh-hhan
opened
1 month ago
1
Do you plan to update the benchmark?
#8
rodion-m
opened
1 month ago
1
Lower test passing rates compared to original results.
#7
holen-zhang
opened
3 months ago
1
Question about the total number of methods in the benchmark
#6
ztwater
closed
1 month ago
3
Evaluation script fails with error
#5
ramsey-coding
closed
2 months ago
3
How to run the unit tests test_pipeline.py?
#4
ramsey-coding
closed
2 months ago
1
Where Can I Submit my Models for evaluation?
#3
ajinkya123-robo
closed
2 months ago
1
Several minor issues when running tests on ClassEval.
#2
ztwater
closed
6 months ago
3
I'd like to test FIM capability of my model,does this test set have a fim subset?(i.e.function list depends on the following context)
#1
zndqs
closed
4 months ago
2