search

IBM / Project_CodeNet

This repository is to support contributions for tools for the Project CodeNet dataset hosted in DAX
Apache License 2.0
1.55k stars 193 forks source link

Didn't find any wrong solutions in Project_CodeNet_Python800 dataset #35

Closed SlinkoIgor closed 3 years ago

SlinkoIgor commented 3 years ago

Project_CodeNet_Python800 and Project_CodeNet_Java250 consist of Accepted answers only. Wonder, where do I find the Wrong solutions?

geert56 commented 3 years ago

Correct. There are no "wrong" solutions in the benchmark datasets that you mentioned. Those derived datasets were particularly curated to only consist of Accepted solutions such that they correctly compile and run. If you would like some of the "wrong" submissions to the problems mentioned in the benchmark datasets you will have to download the full Project CodeNet dataset. Instructions are of course in the README for this github.