obfuscurity / judy

Bespoke service for reviewing CFP submissions
http://obfuscurity.github.io/judy
Other
25 stars 6 forks source link

Randomization should account for distribution of reviews #33

Open obfuscurity opened 6 years ago

obfuscurity commented 6 years ago

Judy currently returns the next abstract to review by selecting a random one from the pool of abstracts that the reviewer hasn't reviewed yet. Unfortunately this results in an uneven bell-curve distribution of reviews (quantity) across the pool of abstracts. We should weight our randomization such that abstracts with fewer reviews are preferred over those with more reviews.

https://github.com/obfuscurity/judy/blob/a29b6c9bd3688b2d17614cef8b2af3f95e6982ec/app/models/abstracts.rb#L94-L98