search

openstates / issues

Having trouble? Looking to contribute? Issues live here!
15 stars 2 forks source link

PA-scrape failing since at least 2024-10-29 #1246

Closed openstates-bot closed 1 month ago

openstates-bot commented 1 month ago

PA-scrape has failed 3 times since 2024-10-29

Logs:

    report["scrape"] = do_scrape(juris, args, scrapers, active_sessions)
  File "/root/.cache/pypoetry/virtualenvs/openstates-scrapers-vRcYrsYN-py3.9/lib/python3.9/site-packages/openstates/cli/update.py", line 133, in do_scrape
    partial_report = scraper.do_scrape(**scrape_args, session=session)
  File "/root/.cache/pypoetry/virtualenvs/openstates-scrapers-vRcYrsYN-py3.9/lib/python3.9/site-packages/openstates/scrape/base.py", line 236, in do_scrape
    for obj in self.scrape(**kwargs) or []:
  File "/opt/openstates/openstates/scrapers/pa/bills.py", line 27, in scrape
    yield from self.scrape_session(chamber, session)
  File "/opt/openstates/openstates/scrapers/pa/bills.py", line 37, in scrape_session
    yield from self.parse_bill(chamber, session, special, link)
  File "/opt/openstates/openstates/scrapers/pa/bills.py", line 73, in parse_bill
    self.parse_bill_versions(bill, page)
  File "/opt/openstates/openstates/scrapers/pa/bills.py", line 121, in parse_bill_versions
    self.scrape_amendments(bill, doc_url, amend_chamber)
  File "/opt/openstates/openstates/scrapers/pa/bills.py", line 142, in scrape_amendments
    html = self.get(link).text
  File "/root/.cache/pypoetry/virtualenvs/openstates-scrapers-vRcYrsYN-py3.9/lib/python3.9/site-packages/requests/sessions.py", line 602, in get
    return self.request("GET", url, **kwargs)
  File "/root/.cache/pypoetry/virtualenvs/openstates-scrapers-vRcYrsYN-py3.9/lib/python3.9/site-packages/scrapelib/__init__.py", line 602, in request
    raise HTTPError(resp)
scrapelib.HTTPError: 404 while retrieving https://www.palegis.us/404
openstates-bot commented 1 month ago

closed via successful run on 2024-10-29