Authors

\author{Changwei Zou}
\affiliation{
  \institution{University of New South Wales, Australia}
 }

\author{Jingling Xue}
\affiliation{
  \institution{University of New South Wales, Australia}
 }

Apply for Reusable and Available

icse2020review commented 4 years ago

The authors provide the source code of the Barra tool along with the instruction on how to build and use the tool. Moreover, they provide a VM image. Test scripts used in the experimental evaluation are also given to enable reproducing the results presented in the paper. The provided research artifacts satisfy the available badge requirements.

timm commented 4 years ago

@icse2020review : what about "reusable" = Functional + very carefully documented and well-structured to the extent that reuse and repurposing is facilitated. In particular, norms and standards of the research community for artifacts of this type are strictly adhered to.

@helpacksi : I look forward to your reviews

helpacksi commented 4 years ago

Artifact is Available

The instructions offered by the authors is easy to follow. I was able to recreate the steps leading to the generation of

Table 1 in the paper
Table 3 in the paper; and
Figure 10 in the paper.

However, at this point, the submitted artifact is Not Reusable for the following reasons:

The artifact itself is not carefully documented. There are no README files anywhere in ~/src/BARRA/R4 of the provided VM.
It may be most useful if the authors can provide some instructions on how to reuse the pipeline in Figure 6 of the paper to harden any C/C++ program using BaaRa.

minkull commented 4 years ago

This is heading towards available but not reusable.

@icse2020review could you confirm your views?

minkull commented 4 years ago

Available to be awarded by end of 24th Feb AoE unless @icse2020review shouts otherwise.

minkull commented 4 years ago

Many thanks for all the discussions!

Available awarded.

researchart / rose6icse

icse20-main-97 #114

Authors

Apply for Reusable and Available