Created opendata_scraper2 module, uses nested lists instead of two separate lists
Updated the majority of opendata_scraper scrapers to opendata_scraper2
Renamed dir to directory as I didn't want it confused with os.dir()
Updated the init files to import opendata_scraper2
Updated template opendata scraper to match new opendata_scraper2 format
Added proper sleep_time intervals to each opendata_scraper2 scraper.
Added a scraper_list to the USA/ folder, someone should go through and add the current scrapers to there so that we know where libraries/modules are being used (in case we have to update)
Created opendata_scraper2 module, uses nested lists instead of two separate lists
Updated the majority of
opendata_scraper
scrapers toopendata_scraper2
Renamed
dir
todirectory
as I didn't want it confused withos.dir()
Updated the init files to import
opendata_scraper2
Updated template opendata scraper to match new opendata_scraper2 format
Added proper
sleep_time
intervals to eachopendata_scraper2
scraper.Added a
scraper_list
to theUSA/
folder, someone should go through and add the current scrapers to there so that we know where libraries/modules are being used (in case we have to update)