Review settings - feedback wanted

[johanvdw]

This is a call for feedback on the review settings.

By default this year:

• devroom managers could give feedback on any submission, also outside their track
• devroom managers who started reviewing their track should stay in their track (this was initially not the case, but is now fixed)
• devroom manager could invite extra people who would only be able to review and get a simpler interface

I think I will keep both roles, but especially looking for feedback on these options:

Everyone reviewing would get the option to score on a range from -1 to 3 (definitely not to definitely) and write a comment.

Some questions:

• do you think we need more levels?
• should reviewers see other reviews, or only after their review?
• should only devroom managers see reviews on their track and not other devroom managers?