OpenUpSA / pmgbilltracker

Bill Tracking Application for the Parliamentary Monitoring Group
Apache License 2.0
5 stars 2 forks source link

Scraper falls over while scraping bills page #34

Closed petrus-jvrensburg closed 10 years ago

petrus-jvrensburg commented 10 years ago
http://www.pmg.org.za/print/bill?year=2014
Traceback (most recent call last):
  File "/var/www/pmgbilltracker/run_scraper.py", line 6, in <module>
    scraper.run()
  File "/var/www/pmgbilltracker/pmg_scrapers/main.py", line 115, in run
    self.scrape_bills()
  File "/var/www/pmgbilltracker/pmg_scrapers/main.py", line 53, in scrape_bills
    bill_scraper.run_scraper()
  File "/var/www/pmgbilltracker/pmg_scrapers/bills.py", line 60, in run_scraper
    while not self.state_fn(row):
  File "/var/www/pmgbilltracker/pmg_scrapers/bills.py", line 179, in version_state
    "date": date_parser.parse(fragment.findAll("td")[1].text).date(),
  File "/var/www/pmgbilltracker/env/local/lib/python2.7/site-packages/dateutil/parser.py", line 748, in parse
    return DEFAULTPARSER.parse(timestr, **kwargs)
  File "/var/www/pmgbilltracker/env/local/lib/python2.7/site-packages/dateutil/parser.py", line 310, in parse
    res, skipped_tokens = self._parse(timestr, **kwargs)
TypeError: 'NoneType' object is not iterable