search

climate-mirror / datasets

For tracking data mirroring progress
201 stars 18 forks source link

NOAA NCEI ICOADS R3.0 #119

Open bkirkbri opened 7 years ago

bkirkbri commented 7 years ago

Name: NOAA's NCEI Global Marine ICOADS R3.0 Organization: NOAA Description URL: http://icoads.noaa.gov/ Download URL: https://www.ncei.noaa.gov/data/marine/icoads3.0 File Types: International Maritime Meteorological Archive (IMMA) format, version 1 Size: 32GB Mirror URLs: https://s3.ca-central-1.amazonaws.com/climate-mirror/index.html

wantonwonton commented 7 years ago

I just started a download to be an offline copy.

gabefair commented 7 years ago

@wantonwonton Great! Can you provide us a link to your dataset once you are done? Thanks

wantonwonton commented 7 years ago

My download finished. Here's a hash for comparison:

find www.ncei.noaa.gov/data/marine/icoads3.0 -type f ! -name "index.html*" | sort | xargs md5sum | md5sum ff022bf0206bc0b4dae51906d71e2682 -

@bkirkbri Can you compare the hash with your mirror? (Note that the command above excludes the index.html files that were included in my download.)