search

kohler / hotcrp

HotCRP conference review software
http://read.seas.harvard.edu/~kohler/hotcrp
Other
321 stars 109 forks source link

Separate visibility of review contents and comments #312

Open halfaya opened 1 year ago

halfaya commented 1 year ago

In settings under PC Reviews there is a multiple-choice option "Can PC members see review contents and comments except for conflicts?" There seems to be no way to allow PC members to see comments without also being able to see other reviews before they submit their own. This has been a problem when used in the Artifact Evaluation Committee in which reviewers communicate anonymously with authors to resolve minor issues before writing their reviews--they cannot see the author comments unless they can also see other reviews before posting their own.

This can also be a problem with workshops and even some conferences in which there is a desire to allow anonymous discussion and clarification between reviewers and authors before review submission. It would be very helpful to have the two concepts decoupled.

One other comment: It is unclear to me what is the difference between the current two options "Yes, unless they haven’t completed an assigned review for the same submission" and "Only after completing a review for the same submission".

JLimperg commented 1 year ago

+1 from the ICFP artifact evaluation committee. We'd very much appreciate finer-grained control here.

goens commented 1 year ago

+1 from the CGO artifact evaluation committee as well!