openstates / issues

Having trouble? Looking to contribute? Issues live here!
15 stars 2 forks source link

MN-scrape failing since at least 2024-04-05 #1179

Closed openstates-bot closed 5 months ago

openstates-bot commented 5 months ago

MN-scrape has failed 5 times since 2024-04-05

Logs:

15:10:36 INFO scrapelib: GET - 'https://www.revisor.mn.gov/bills/bill.php?b=House&f=HF5000&ssn=0&y=2024'
15:10:36 INFO openstates: save bill HF 5000 in 2023-2024 as bill_a807f284-f35e-11ee-bc97-0a58a9feac02.json
15:10:37 INFO openstates: Message ID: 663369fe-0555-4859-8b02-1b4458369ac9
15:10:37 INFO scrapelib: GET - 'https://www.revisor.mn.gov/bills/bill.php?b=House&f=HC0006&ssn=0&y=2024'
Traceback (most recent call last):
  File "/root/.cache/pypoetry/virtualenvs/openstates-scrapers-vRcYrsYN-py3.9/bin/os-update", line 8, in <module>
    sys.exit(main())
  File "/root/.cache/pypoetry/virtualenvs/openstates-scrapers-vRcYrsYN-py3.9/lib/python3.9/site-packages/openstates/cli/update.py", line 541, in main
    report = do_update(args, other, juris)
  File "/root/.cache/pypoetry/virtualenvs/openstates-scrapers-vRcYrsYN-py3.9/lib/python3.9/site-packages/openstates/cli/update.py", line 337, in do_update
    report["scrape"] = do_scrape(juris, args, scrapers, active_sessions)
  File "/root/.cache/pypoetry/virtualenvs/openstates-scrapers-vRcYrsYN-py3.9/lib/python3.9/site-packages/openstates/cli/update.py", line 124, in do_scrape
    partial_report = scraper.do_scrape(**scrape_args, session=session)
  File "/root/.cache/pypoetry/virtualenvs/openstates-scrapers-vRcYrsYN-py3.9/lib/python3.9/site-packages/openstates/scrape/base.py", line 238, in do_scrape
    for iterobj in obj:
  File "/opt/openstates/openstates/scrapers/mn/bills.py", line 302, in get_bill_info
    bill = self.extract_versions(bill, doc)
  File "/opt/openstates/openstates/scrapers/mn/bills.py", line 591, in extract_versions
    current_pdf_url = current_content.xpath(pdf_xpath)[0].xpath("@href")[0]
IndexError: list index out of range
openstates-bot commented 5 months ago

closed via successful run on 2024-04-07