search

opencivicdata / scrapers-ca

Canadian legislative scrapers
MIT License
29 stars 25 forks source link

Update Mercier scraper #388

Closed rafe-murray closed 1 month ago

rafe-murray commented 1 month ago

Updated the scraper for the new site layout and added phone numbers.

jpmckinney commented 1 month ago

I'm getting 

  File "scrapers/ca_qc_mercier/people.py", line 9, in scrape
    page = self.lxmlize(COUNCIL_PAGE)
  File "scrapers_ca_app/scrapers/utils.py", line 216, in lxmlize
    raise etree.ParserError("Document is empty {}".format(url))
lxml.etree.ParserError: Document is empty https://www.ville.mercier.qc.ca/affaires-municipales/conseil-municipal/membres-du-conseil/
rafe-murray commented 1 month ago

I can't replicate this on my machine. Maybe it has something to do with the system it's running on?

jpmckinney commented 1 month ago

It seems to succeed remotely too now - must have been a random remote issue.