adieyal
commented
10 years ago There was a problem with the cronjob on those days. The producer was still collecting urls but the consumers weren't scraping them. I think that we didn't miss anything though, we just downloaded the articles later. You should see a spike after that period showing that we downloaded a bunch of articles that backed up.
Adi
On 13 April 2014 18:02, aserlich notifications@github.com wrote:
Hi Adi,
I am looking on Mixpanel and it looks across all news sites we got no data from April 8-10. I didn't look at the error logs for a couple of days. Could you verify that nothing was down during that time period? Or if the problem is on the mixpanel end?
Reply to this email directly or view it on GitHubhttps://github.com/Code4SA/various-scrapers/issues/8 .
Adi Eyal Director Code for South Africa Promoting informed decision-making
phone: +27 78 014 2469 skype: adieyalcas linkedin: http://za.linkedin.com/pub/dir/Adi/Eyal web: http://www.code4sa.org twitter: @soapsudtycoon
For more information on how to participate in the open data community in South Africa, go to: http://www.code4sa.org/#community
Hi Adi,
I am looking on Mixpanel and it looks across all news sites we got no data from April 8-10. I didn't look at the error logs for a couple of days. Could you verify that nothing was down during that time period? Or if the problem is on the mixpanel end?