search

dokato / healthcareonlinesources

WHAT - NHS Hackathon project
MIT License
2 stars 2 forks source link

Preventing nafarious scoring from bad actors #17

Open El-Suri opened 4 years ago

El-Suri commented 4 years ago

Some ideas as to how the general public can contribute to the scoring whilst preventing the ability of bad faith actors to skew results in favour of non-reputable sources. n.b These are not all my ideas, just thought I'd put them in one place, feel free to add/ comment.

  1. Heavily weighting medical experts scores and giving minimal weight to other contributors. This could work but has the disadvantage still that lots of people (and there are presumably more general public than professionals) giving bad websites a good name (or the other way around) can still effect the score.

  2. Weighting according to agreement with healthcare professionals - aka - The 'snowball' weighting system. This would allow us to take advantage of the fact that there are many more non-professionals who can fine-tune a score, whilst making sure scores that are outliers do not interfere that much with the general direction.

  3. Not having the general public contribute to the score, instead they can 'flag' websites for review by the healthcare professionals or trusted sources.

  4. Making the reporting system more in-depth. For example, they would need to fill out a short form explaining why they have given this score. This would stop score spamming of a given website.

  5. Not having the general public contribute to the score, instead simply keeping a record of user 'thumbs up' and 'thumbs down' that would be easily visible when using the extension. Users could then click into this for more information and perhaps some feedback from a healthcare professional or user comment.

dokato commented 4 years ago

Thank @El-Suri. That's really useful!