search

openstates / issues

Having trouble? Looking to contribute? Issues live here!
15 stars 2 forks source link

ND-scrape failing since at least 2024-04-16 #1187

Closed openstates-bot closed 6 months ago

openstates-bot commented 6 months ago

ND-scrape has failed 5 times since 2024-04-16

Logs:

    for obj in self.scrape(**kwargs) or []:
  File "/opt/openstates/openstates/scrapers/nd/bills.py", line 168, in scrape
    yield from bill_list.do_scrape()
  File "/root/.cache/pypoetry/virtualenvs/openstates-scrapers-vRcYrsYN-py3.9/lib/python3.9/site-packages/spatula/pages.py", line 277, in do_scrape
    yield from self._to_items(scraper)
  File "/root/.cache/pypoetry/virtualenvs/openstates-scrapers-vRcYrsYN-py3.9/lib/python3.9/site-packages/spatula/pages.py", line 228, in _to_items
    yield from item._to_items(scraper)
  File "/root/.cache/pypoetry/virtualenvs/openstates-scrapers-vRcYrsYN-py3.9/lib/python3.9/site-packages/spatula/pages.py", line 208, in _to_items
    self._fetch_data(scraper)
  File "/root/.cache/pypoetry/virtualenvs/openstates-scrapers-vRcYrsYN-py3.9/lib/python3.9/site-packages/spatula/pages.py", line 188, in _fetch_data
    self.process_error_response(e)
  File "/root/.cache/pypoetry/virtualenvs/openstates-scrapers-vRcYrsYN-py3.9/lib/python3.9/site-packages/spatula/pages.py", line 301, in process_error_response
    raise exception
  File "/root/.cache/pypoetry/virtualenvs/openstates-scrapers-vRcYrsYN-py3.9/lib/python3.9/site-packages/spatula/pages.py", line 171, in _fetch_data
    response = self.source.get_response(scraper)  # type: ignore
  File "/root/.cache/pypoetry/virtualenvs/openstates-scrapers-vRcYrsYN-py3.9/lib/python3.9/site-packages/spatula/sources.py", line 45, in get_response
    return scraper.request(
  File "/root/.cache/pypoetry/virtualenvs/openstates-scrapers-vRcYrsYN-py3.9/lib/python3.9/site-packages/scrapelib/__init__.py", line 602, in request
    raise HTTPError(resp)
scrapelib.HTTPError: 503 while retrieving https://ndlegis.gov/assembly/68-2023/regular/bill-overview/bo1481.html
openstates-bot commented 6 months ago

closed via successful run on 2024-04-18