search

researchart / fse18

artifacts track, FSE'18: https://2018.fseconference.org/home
2 stars 2 forks source link

Baltes_Expertise-Artifact #32

Closed obaysal closed 6 years ago

obaysal commented 6 years ago

https://github.com/researchart/fse18/tree/master/submissions/sbaltes-expertise-artifact

timm commented 6 years ago

this artifact certainly satisfies "reusable and available"

however, i can't give it "replicated" since our criteria is "main results of the paper have been obtained in a subsequent study by a person or team other than the authors, using, in part, artifacts provided by the author".

so my call is "available"

timm commented 6 years ago

@obaysal : i just reviewed this artifact. so now we await @anonReviewer 's opinion

obaysal commented 6 years ago

I agree with @timm. The artifact satisfies the requirements of the Reusable and Available badges. @sbaltes would you agree with this?

sbaltes commented 6 years ago

Yes, of course. As I wrote in the STATUS file, the qualitative part is hard to replicate (at least in the context of an artifact evaluation). Considering this, Reusable and Available seems to be the right choice.

anonReviewer commented 6 years ago

The artifact appears complete for "Available" from just navigating and reading the files, but I cannot check this one completely due to having left town for a few days.