govdirectory / website

Website repository for Govdirectory - a crowdsourced and fact-checked directory of official governmental online accounts and services.
https://govdirectory.org
Creative Commons Zero v1.0 Universal
44 stars 29 forks source link

Figure out data quality threshold #46

Closed Ainali closed 2 years ago

Ainali commented 2 years ago

We should define some threshold for how good the data of a country must be before we publish it on the website. This should then be clearly communicatied on https://www.wikidata.org/wiki/Wikidata:Gov_Directory#Add_your_country so that any volunteer know exactly what they need to do before a country gets added.

Ainali commented 2 years ago

I am thinking that we should use the star system we started with to display this. What we have is good up until ★★. This makes it theoretically possible to display some data. But of course we would like some quality as well. Proposal:

★★★: All agencies can be queried for their level/type and the structure is documented on the country page ★★★★: Import of official COFOG data has been made. ★★★★★: A manual review has been made on each agency for which online accounts they have. The review is documented on the country page with a date.

Does it make sense to use 5 stars as a threshold? I intentionally left out further quality with references for now, and I am unsure if that should be part of the threshold or just something we should use as a trust indicator.

Ainali commented 2 years ago

Here is an idea that is somewhat inline with the addition we did with UK and Greenland. We could add countries with a specific level, but then perhaps we should specify on the country page what levels we have added and which one is missing (perhaps even with a link to a page on Wikidata). This would make it much quicker to add a lot of data to the site, and we might even allow ourselves higher quality barriers on the things we add since the work to do each step is smaller.

Abbe98 commented 2 years ago

We currently display the descriptions from the country configurations. We could add Wikidata links as well but I'm not sure it would be helpful to most users.

Ainali commented 2 years ago

Ah, that is great! And I think you are right, most people won't understand what to do there unless we give them good instructions. And that might not be feasible for each country. To solve this, we should probably have one funnel for "Do you want to help?".

Ainali commented 2 years ago

So with that said, should we:

  1. settle on the suggested star rating?
  2. make the limit for showing data on the website 3 stars, but that it doesn't need to be the whole country, any well defined part would work?
Abbe98 commented 2 years ago

Three-star rating for individual levels but 2 for entire countries?

Ainali commented 2 years ago

I had proposed changing the three stars :) The page has been updated with this notion: https://www.wikidata.org/w/index.php?title=Wikidata%3AWikiProject_Govdirectory&type=revision&diff=1488446642&oldid=1484360436