search

openrightsgroup / blocked-org-uk

Template front-end code, markup, style-sheets, images and other assets for the Censorship Monitoring Project (blocked.org.uk)
https://www.blocked.org.uk/
GNU General Public License v3.0
13 stars 5 forks source link

Front page stat "27,565,320 sites tested" #355

Closed JimKillock closed 5 years ago

JimKillock commented 5 years ago

Hi Dan

I guess this means 'fully tested' or something similar? Could we have a figure that gives a better indication of the actual no of sites that have been partly tested?

dantheta commented 5 years ago

This number is accurate, and represents partial (i.e not all networks) results - we're currently adding half a million a week (which, with an average number of networks is 6 million results per week). I've identified a bottleneck during the the URL queueing that will let us open the throttle wider.

dantheta commented 5 years ago

The bulk testing from the scheduler is currently suspended (disk space), but they're still trickling through from the original requeue system. The status on the test scheduler control panel will catch up when it's running again.