researchart / re21

2 stars 5 forks source link

Review of submission Ziyan_RE_AE #9

Open LloydThinks opened 3 years ago

LloydThinks commented 3 years ago

Author: @ZacharyZhao55 Reviewer 1: @artifactreviewer Reviewer 2: @52162

52162 commented 3 years ago

Artifact description should make sense to the reader at first glance. As it stands (below), your description is too brief.

"Artifacts Available Justification: The two avaliable case data mentioned in this article. UAV(Unmanned Aerial Vehicle) Case and BAS(Building Automation System) Case Description of Artifacts:Software requirements documents and domain model."

Please put a newline between the links for the two artifacts location, so that it is clear that they are two links.

artifactreviewer commented 3 years ago

I echo @52162's comments. As it stands, I have no idea what this artifact is about.

LloydThinks commented 3 years ago

@52162 and @artifactreviewer, the authors appear to only be applying for the Available badge, which does not require the README.md. Please review the submission on the merits of availability only. For reference, here is the Submission and Reviewing Guidelines [1].

[1] https://conf.researchr.org/getImage/RE-2021/orig/RE%2721+Artifact+Track+-+Submission+and+Reviewing+Guidelines.pdf

Thank you

artifactreviewer commented 3 years ago

I see that there are five criteria required for the Artifacts Available badge in the Guidelines. Of these, I think the requirement that "Artifacts have a Digital Object Identifier (DOI) redirecting to the immutable URL." is not satisfied. Here is some information on how to get a DOI for a github page -- https://guides.github.com/activities/citable-code/

LloydThinks commented 3 years ago

In addition, please note that Github by itself does not satisfy the requirement of an immutable URL. The authors can take down their repository at any time. Please refer to sites such as Zenodo and FigShare for immutable artifact storage.

@ZacharyZhao55 please read and react to the Available badge requirements and we hope to assign your artifact the Available Badge.

LloydThinks commented 3 years ago

Dear @ZacharyZhao55, @artifactreviewer, and @52162, thank you for the reviews and discussion regarding this submission.

It appears as if @ZacharyZhao55 has updated their submission to include a DOI pointing to Zenodo [1]. With this update in mind, do you recommend the badge of Available? If so, please reply with short message such as "I believe this badge deserves the badge of Available." If you don't believe they deserve the badge of available, please reply with details as to why they do not yet qualify.

[1] https://doi.org/10.5281/zenodo.5082430

Thank you for your contributions,

Lloyd & Nash

artifactreviewer commented 3 years ago

I believe this artifact meets the requirements for "Artifacts Available" badge.