IATI / IATI-Publishing-Statistics

Tables and files presenting different stats for IATI publishers
http://publishingstats.iatistandard.org
4 stars 3 forks source link

Yellow flags (i.e. future transaction indicators) on timeliness pages are incorrect #17

Open andylolz opened 3 years ago

andylolz commented 3 years ago

The yellow flags on the timeliness frequency and timelag pages are intended to indicate that a publisher has reported future transactions in the last 12 months. However, that information is not currently shown on the page.

The relevant data stopped recording on the publishingstats server on 2019-07-22 – presumably this was around the time the dashboard and publishing stats were split: http://publishingstats.iatistandard.org/stats-blacklist/gitaggregate-publisher-dated/drc/activities_with_future_transactions.json

The relevant data is still recorded on the dashboard server, here: http://dashboard.iatistandard.org/stats-blacklist/gitaggregate-publisher-dated/drc/activities_with_future_transactions.json

There are yellow flags on these dashboard pages, but they’re actually flagging something different. They actually indicate an error with publishingstats (not with the publisher’s data), because the publisher wasn’t found in the future transactions data. That’s because there is no future transaction data for these publishers, because they started after this data stopped being recorded.

So these yellow flags are now just saying “this publisher started publishing after 2019-07-22”.

If you check the data-severity for these yellow flags, it’s actually -1, indicating an error: https://github.com/IATI/IATI-Publishing-Statistics/blob/edb5b14a2382ec45aeac7b8e10995a7ac7fc6774/IATI-Dashboard/timeliness.py#L168-L174

stevieflow commented 3 years ago

Good spot @andylolz

I know of a few publishers that are concerned about these yellow flags. If these are false, then it'd be greatly appreciated to resolve the issue