search

climate-mirror / datasets

For tracking data mirroring progress
201 stars 18 forks source link

National Oceanic Data Center Archive #314

Open JeremiahCurtis opened 7 years ago

JeremiahCurtis commented 7 years ago

ftp://ftp.nodc.noaa.gov/pub/data.nodc/nodc/archive/data/

donbright commented 7 years ago

subset of #163

markuslaker commented 7 years ago

The total size of this data set is roughly 900GiB. That is, unfortunately, too large for me to mirror.

0012345 -> /nodc/archive/arc0007/0012345/1.1/data/0-data    1.5GiB
0038589 -> /nodc/archive/arc0017/0038589/26.26/data/0-data  14GiB
0055092 -> /nodc/archive/arc0022/0055092/1.1/data/0-data    529MiB
0065055 -> /nodc/archive/arc0027/0065055/2.2/data/0-data    165MiB
0067029 -> /nodc/archive/arc0034/0067029/1.1/data/0-data    1.2GiB
0068974 -> /nodc/archive/arc0030/0068974/1.1/data/0-data    12MiB
0071185 -> /nodc/archive/arc0034/0071185/1.1/data/0-data    1.4GiB
0077816 -> /nodc/archive/arc0041/0077816/2.3/data/0-data    5.9GiB
0092527 -> /nodc/archive/arc0047/0092527/2.2/data/1-data    44MiB
0094866 -> /nodc/archive/arc0052/0094866/1.1/data/0-data    6.1GiB
0112824 -> /nodc/archive/arc0061/0112824/3.5/data/0-data    53GiB
0114640 -> /nodc/archive/arc0062/0114640/3.3/data/0-data    1.2MiB
0114815 -> /nodc/archive/arc0079/0114815/3.3/data/0-data    112GiB
0115771 -> /nodc/archive/arc0081/0115771/2.2/data/0-data    52GiB
0117075 -> /nodc/archive/arc0092/0117075/1.1/data/0-data    81GiB
0118478 -> /nodc/archive/arc0066/0118478/3.3/data/0-data    101GiB
0119894 -> /nodc/archive/arc0067/0119894/3.3/data/1-data    64MiB
0123217 -> /nodc/archive/arc0070/0123217/3.3/data/1-data    3.3MiB
0123282 -> /nodc/archive/arc0072/0123282/2.2/data/1-data    51MiB
0123300 -> /nodc/archive/arc0074/0123300/3.4/data/0-data    21GiB
0125535 -> /nodc/archive/arc0077/0125535/23.23/data/0-data  3.8MiB
0126772 -> /nodc/archive/arc0074/0126772/2.2/data/1-data    103MiB
0127259 -> /nodc/archive/arc0078/0127259/1.1/data/1-data    184MiB
0127320 -> /nodc/archive/arc0078/0127320/1.1/data/1-data    54MiB
0127325 -> /nodc/archive/arc0078/0127325/1.1/data/1-data    180MiB
0129374 -> /nodc/archive/arc0077/0129374/1.1/data/0-data    206GiB
0137858 -> /nodc/archive/arc0087/0137858/1.2/data/0-data    50MiB
0155889 -> /nodc/archive/arc0092/0155889/1.1/data/0-data    170GiB
0156446 -> /nodc/archive/arc0096/0156446/1.1/data/0-data    5.9GiB
0156768 -> /nodc/archive/arc0098/0156768/1.1/data/0-data    43G
rustyguts commented 7 years ago

I am pulling now.

gabefair commented 7 years ago

@RustyGuts , were you able to finish?

ivanstegic commented 7 years ago

I am getting this! It is available live as the data is mirrored here: http://data.ourdataourhands.org/ftp.nodc.noaa.gov/