A mechanic to check if the evaluations are consistent and not affected by the batch. Some answers will be displayed for assessment more than once. There are several methods for choosing answers:
[ ] Random
[x] Score outliers. Those that differ from the rest of the batch
[x] Equal scores. Pick a random among those with the same scores in a batch
[x] Correlation between answer length and high score
A mechanic to check if the evaluations are consistent and not affected by the batch. Some answers will be displayed for assessment more than once. There are several methods for choosing answers:
What methods to implement is yet to be decided.