search

mysociety / pombola

GNU Affero General Public License v3.0
65 stars 41 forks source link

Hansard scraper errors aren't sent to developers #2505

Closed chrismytton closed 5 years ago

chrismytton commented 5 years ago

The output from running bin/update_hansard.bash currently goes to mzalendo-managers email alias, which doesn't have any developers on. This is because when the script runs correctly it produces a list of speaker names that can't be matched to a person, and a link to the admin section to go and fix them. But when the script fails for whatever reason the errors are also sent to this alias. This means that we weren't aware that Kenya's Hansard has been failing since August (https://github.com/mysociety/pombola/issues/2502 is tracking that).

I think we should split the Hansard cron job into two parts, one that does the scraping and parsing, and another that emails a list of aliases that need checking. Then all cron errors can go to developers, and only the relevant bits go to Mzalendo managers.

chrismytton commented 5 years ago

Fixed in #2506, which has now been deployed to production. So we should start seeing emails if/when the bin/update_hansard.bash script encounters an error.