search

CEHI-code-repos / residential-history

A web crawler used to extract the residential history from a specific website. This is a project of CEHI.
https://cehi.rice.edu/
GNU General Public License v3.0
0 stars 1 forks source link

A script to download all the data files in a website #4

Open HenryLeongStat opened 6 years ago

HenryLeongStat commented 6 years ago

Designed for https://www.epa.gov/hesc/rsig-related-downloadable-data-files#output, but can be used for other websites.

For example, run python webdata_downloader.py -url https://www.epa.gov/hesc/rsig-related-downloadable-data-files#output -years 2002-2005 in command line. Simply change the website and and years' argument.