Review of submission Kwan_RE_AE

[LloydThinks]

Author: @dkwan33 Reviewer 1: @re2021artefact-reviewer Reviewer 2: @reviewerRE2021artifact

[reviewerRE2021artifact]

To award the available badge the authors need to:

1. provide a DOI (this is not done by FigShare)
2. provide the link to a unique repository in which all the content is located. Currently, there are two different links.
3. provide a brief explanation of what is the content of the artifact, some context about it, and how it can be reused by other authors.

I recommend the authors to create a Zenodo repository with all the content, so that they have a DOI, and everything is in the same place. The description of the artifact can also be included in Zenodo.

[re2021artefact-reviewer]

Summary

• The authors applied for an Available badge.
• The artifacts made available are the high-resolution graph representing the theory resulting from the study, and tables reporting detailed results of the coding process.
• The artifacts are persistently archived on FigShare and are citable via DOI.

Must fix

To fulfill the criteria for the badge, the authors need to reference the artifact (using the DOI) in the paper.

Good to have

• I recommend adding the DOI link on each of the artifacts made available (e.g., overlay on the graphs and in an excel cell).
• I recommend the author add a short README file explaining how to interpret each artifact (e.g., a legend for the graph and a description of the columns in the tables).
• I recommend archiving the pre-print on an archival site, such as arXiv.

[dkwan33]

Thank you both for your review and comments.

• All artifacts (the graphs and the matrices) have been uploaded to a single repository on zenodo. A readme has been added as well as a legend for the graphs.
• The link to the zenodo repository is: https://zenodo.org/record/5076626
• The corresponding doi is: 10.5281/zenodo.5076626
• This doi has been referenced in the paper in Section II Para 7 and Section IIIa Para 1.
• The updated pre-print can be found at: https://github.com/dkwan33/Towards-Achieving-Trust-Through-Transparency-and-Ethics-Pre-Print/blob/main/Paper_ForRE_v4.04.pdf
• The pre-print has also been uploaded to arxiv (submit/3827313) but it is still being processed.
• Edit (7/7/2021): Pre-print has been approved on arxiv at: https://arxiv.org/abs/2107.02959

Please let me know if there are any more issues.

Thanks, -David

[LloydThinks]

Thank you for your reviews and response from the author. @reviewerRE2021artifact @re2021artefact-reviewer , are you satisfied with the changes made by the authors? If so, please let me know by responding with a short "I recommend the badge of Available". If you are not satisfied with the changes made by the authors, please respond with additional feedback.

Lloyd & Nash

[reviewerRE2021artifact]

I recommend the badge of Available.

I would also suggest the authors to:

• refer the arXiv link in Zenodo
• enrich the excel with excerpts from the data sources, so that there is a clear chain of evidence between the data and the extracted codes.

[re2021artefact-reviewer]

I recommend the Available badge, as requested for this submission.