search

climate-mirror / datasets

For tracking data mirroring progress
201 stars 18 forks source link

NOAA NCDC Quality Controlled Local Climatological Data (QCLCD) #118

Open bkirkbri opened 7 years ago

bkirkbri commented 7 years ago

Name: NOAA NCDC Quality Controlled Local Climatological Data (QCLCD) Publication Organization: NOAA NCDC Description URL: https://data.noaa.gov/dataset/quality-controlled-local-climatological-data-qclcd-publication Download URL: https://www.ncdc.noaa.gov/orders/qclcd/ File Types: .tar.gz ZIP Size: 11 GB Status: One Mirror Mirror URL: https://s3.ca-central-1.amazonaws.com/climate-mirror/index.html

wantonwonton commented 7 years ago

I'm downloading this to be an offline copy.

wantonwonton commented 7 years ago

My download finished. I used wget -N -m -e robots=off (which did produce some extra files, like "index.html?C=D;O=A"). Here's a hash for comparison:

find www.ncdc.noaa.gov/orders/qclcd/ -type f ! -name .listing | xargs md5sum | sort -k 2 | md5sum 6ef3df73ac8d977712cfcd69f5a28fc5 -