Closed dev225reddys closed 2 years ago
We are going to have more advanced roles and organizations. We will not have an explicit validator. Any person who is assigned on a job, can validate the corresponding task. I will close the issue as outdated.
When thinking about crowdsourcing annotations, shouldn't we review the points in the issue and decide to reopen it if necessary?
Instead of Validator
, we can have some other name like CrowdSourced Annotater
, which might refer to a group of crowdsource annotators instead of a single person.
By this, when assigning a task to CrowdSourced Annotater
, all the jobs in that task are assigned to them based on an internal algorithm that decides which job is assigned to which annotator. A single job is assigned to multiple annotators; similarly, an annotator would have multiple jobs to annotate.
*2nd issued already, but for Classification of Images but not for Validation of Annotation.