search

ieee-security / ongoing-submission-plan

Public forum for detailed planning of a VLDB-like ongoing submission model for IEEE S&P
Creative Commons Zero v1.0 Universal
15 stars 4 forks source link

On-boarding and off-boarding the editorial board members #10

Open parno opened 8 years ago

parno commented 8 years ago

In Issue #7, @danwallach says:

There were some members of our board who were fantastic about getting their assignments done. Others? Not so much. I don't have fantastic advice about how to get people engaged and keep them productive, nor can I say when it's time to cut the cord. My advice is to create multiple tiers of engagement, and allow people to ramp up and down their commitments. It's probably a good idea to be super inclusive for the editorial board, letting you scale the number of reviews per reviewer without killing anybody. You might also want to consider subcommittees on particular hot topics for any given year, so if we get 30 papers on the same topic which get disjoint reviewers, the subcommittee members will be likely to have better coverage and can reduce some of the randomness inherent in the review process.

parno commented 8 years ago

Good points! We do plan to expand the PC, so as to keep the monthly review load relatively low. We're also currently planning to try to ensure that reviewers only receive new reviews every other month, to help keep things manageable.

As with any conference, we will continue to maintain a history of reviewers that submit high-quality timely reviews, and those who do not, and we'll use that information to inform future PC selections. VLDB has been fairly successful at doing this, and their PC chairs tell us that they've only had to blacklist a few reviewers.

See also FAQ #11.