search

biglocalnews / warn-scraper

Command-line interface for downloading WARN Act notices of qualified plant closings and mass layoffs from state government websites
https://warn-scraper.readthedocs.io
Apache License 2.0
29 stars 10 forks source link

fixed pa scraper #517

Open Ash1R opened 1 year ago

Ash1R commented 1 year ago

I ended up using Chris's code instead of mine for most of it, but I changed the output_rows to a list and accounted for some order switching and missing values. Also learned that Pennsylvania is a commonwealth.

palewire commented 1 year ago

Broadly speaking, what needed to change?

Ash1R commented 1 year ago

Broadly speaking, what needed to change?

Writing a dict to csv was having some issues, so I converted it to a list and used the default write_rows_to_csv Also, the dates were being placed in separate columns, so I put them in a comma separated string and placed them in one column.

stucka commented 1 year ago

Triggering tests by closing and reopening.

stucka commented 1 year ago

Getting a sphinx error on tests 40 scrapers found 21 scrapers have docs state["source"] = module.__source__ AttributeError: module 'warn.scrapers.pa' has no attribute '__source__' make: *** [Makefile:127: tally-sources] Error 1 Error: Process completed with exit code 2.