researchart / fse18

artifacts track, FSE'18: https://2018.fseconference.org/home
2 stars 2 forks source link

statistics progres artifacts 2016 2017 2018 #34

Open timm opened 6 years ago

timm commented 6 years ago

nearly everyone got the badge they asked for (exception: one or two authors did not realize the "reproduced" meant reproduced by other people). and some authors even got upgrades (e.g. they asked for available and got "replicated").

obaysal commented 6 years ago

FSE 2018: 20 artifacts were submitted and reviewed out of 55 accepted papers (36% of FSE papers received ACM badges)

obaysal commented 6 years ago

FSE 2016: 17 artifacts were submitted and reviewed out of 74 accepted papers (23% artifacts submission rate).

timm commented 6 years ago

a quarter to a third? that's a large growth! imagine getting to the point where we can say SE research is that field that produces artifacts that let other people check their conclusions?