a way to resolve conflicting transcriptions

[cathydeng]

storing data:

• there should be another table that represents 'final' transcriptions, with one record per image. when an image has been transcribed by the required # of reviewers, if the transcriptions match, the record should be added to the 'final' transcriptions automatically. otherwise, an image transcription will need to be 'resolved'
• the final transcriptions are what will be exported when an admin exports to csv

interface:

• on the view transcriptions page, there should be a high level table with one row per image. this will have (1) image id, (2) number of reviewers the image has seen, & (3) whether there are conflicts (reasoning behind this is that being able to see multiple transcriptions is only important when there are conflicts)
• there should be a transcription detail page, where an admin can see transcriptions next a given image, and resolve conflicts if any

this would close #52 & #43

[philbrondyke]

Sounds great. Yep, that would close 52 and 43.

[cathydeng]

implementation:

instead of manually resolving conflicts, add another setting to the task metadata for a concurrence threshold (& treat # reviewers as min # of reviewers, not absolute num), e.g. accept a transcription as final if 3/4 of transcriptions agree. images will continue to be served to transcribers until they have reached both the concurrence threshold & the min # of reviewers.

[cathydeng]

implemented