search

openrightsgroup / cmp-issues

Centralised issue-tracking for the Blocked backend
2 stars 0 forks source link

Reply stats by network: add mistake column #233

Closed JimKillock closed 5 years ago

JimKillock commented 5 years ago

Add a column indictating "Resolved to blocked against policy".

This would be calculated from those results where we had a response or knew about one, and the ISP decided to continue to block, but we have recorded this as "Block did not match the ISP's policy".

NB: we may want to add some further thought to how this is all recorded, as the mistakes may 'rectify' themselves or 'create' themselves when websites change content and classification.

dantheta commented 5 years ago

If we base this solely on the individual ISP reports and the email replies, then it isn't so much of a moving target. We would count ISP reports that have "matched_policy: false" and "email reply status: rejected". Factoring in the retesting system would cause these figures to fluctuate over time.

dantheta commented 5 years ago

This column does still factor in the "unblocked" status from the URL testing system, so it may drift a bit over time. The report table column is present now.

dantheta commented 5 years ago

Seems to be working consistently. Please feel free to re-open or file a new bug if it isn't working as expected.