search

zooniverse / AnnoTate

Full text transcription app for the Tate Britain
http://anno.tate.org.uk
Other
12 stars 2 forks source link

highlighting hard to transcribe lines #174

Open ggdhines-zz opened 9 years ago

ggdhines-zz commented 9 years ago

@rogerhutchings - @VVH and I were talking about the idea of having gold dots around lines which have been transcribed by 5 people but the aggregated line has low accuracy. that would highlight lines that are hard to transcribe for people who might want a challenge. This is reasonably easy to do from my end - how hard would it be for you? Definitely a longer term goal

VVH commented 9 years ago

Hey both, this is one I'd like to implement in the next few weeks and then we can send an email to those taking part in AnnoTate, announcing 'gold mode' lines that need attention. Sound good?

ggdhines-zz commented 9 years ago

I have now included a param in the cluster results called "agreement" which gives the % percent of characters in a set of transcriptions for which we have reached agreement (based on a 75% percent threshold per character).

rogerhutchings commented 9 years ago

Okay - so what threshold should we set for the lines to go gold? @ggdhines @VVH

ggdhines-zz commented 9 years ago

I'm going to suggest that if after 5 users, we haven't reached 80% agreement. (On average, there is about 97% agreement after 5 users)