search

researchart / rose6icse

12 stars 71 forks source link

humbatova-icse20-main-477 #106

Closed minkull closed 4 years ago

minkull commented 4 years ago

https://github.com/researchart/rose6icse/tree/master/submissions/available/humbatova-icse20-main-477 https://github.com/researchart/rose6icse/tree/master/submissions/reusable/humbatova-icse20-main-477

Nargiz Humbatova (nh17937) Gunel Jahangirova (guneljahan) Gabriele Bavota Vincenzo Riccio Andrea Stocco Paolo Tonella

Note to reviewers: these authors want multiple badges

sec365 commented 4 years ago

The authors provided a clearly structured replication package, consisting of a large amount of data related to their study. I checked through the files and did not see any obvious mistakes. I appreciate the efforts the authors had put into this study. I am particularly impressed by the detailed records of several rounds of manual analyses of GitHub issues, PRs, and SO posts, the open coding process, and the transcriptions of the interviews.

The package not only allows the replication of the paper’s findings but also provides a good dataset of deep learning system faults for future research.

I believe the submission satisfies the criteria of “available” and “reuse”. I am happy to recommend both badges.

One suggestion to is to put the datasets on Zenodo (or similar services) and provide a DOI.

happyanonymous commented 4 years ago

I agree that the submission satisfies the criteria of "available"and "reuse" and I am happy to recommend both badges.

I'd also like to second the suggestion of assigning a unique DOI to the dataset (e.g., via Zenodo)

nh17937 commented 4 years ago

Thank you very much for the provided feedback. As per your suggestion, the dataset is now published on Zenodo (DOI: 10.5281/zenodo.3667541)

timm commented 4 years ago

@nh17937 : can you do a pull request where that DOI is in the INSTALL.d file? thanks!

nh17937 commented 4 years ago

@timm: sure, thank you, I have created the pull request