Greg4cr / sbse-sigsoft-standard

Proposed ACM SIGSOFT Standard for Optimization Studies in SE (including SBSE).
https://arxiv.org/abs/2010.03525
23 stars 6 forks source link

Suggestion for novelty and reproduction criteria #2

Closed xdevroey closed 3 years ago

xdevroey commented 3 years ago

The novelty and reproduction criteria were not really actionable for a reviewer. The paper should state if and how it is novel, or if it reproduces previous results (and any improvements). It also avoids the pitfall of having reviewers rejecting papers because "it is not novel enough" (which is a general review antipattern detailed in the empirical standards (page 5).