own-pt / cl-wnbrowser

A collaborative editor for OpenWordnet-PT.
http://openwordnet-pt.org
Other
7 stars 8 forks source link

How to handle identical suggestions by automated systems? #145

Open fcbr opened 8 years ago

fcbr commented 8 years ago

Example: http://wnpt.brlcloud.com/wn/synset?id=00325208-v

The automated suggestion was made, which was identical to one already suggested by someone else. One was voted and committed and the other one was receiving enough votes to be committed again. We need to decide what to do in this case:

  1. Prevent automated systems from making duplicated suggestions -- good, but likely hinder analyses of automated systems.
  2. Educate users to vote down on duplicated suggestions -- works, but it is inconsistent. The suggestions are good, regardless whether they were already suggested.
  3. Disable voting on duplicated suggestions -- good, but may skew analyses of the performance of automated systems, same as (1).
  4. Allow voting, but just don't commit duplicated suggestions -- we would probably need to create a new status type for this, such as "ignored" or "duplicated" to indicate that was a good suggestion, but duplicated.
fcbr commented 8 years ago

We should delete the duplicate suggestions. We should keep only the older one.