search

climate-mirror / datasets

For tracking data mirroring progress
201 stars 18 forks source link

Dataset at ftp:/data.ncdc.noaa.gov/cdr/ocean-atmos-props #155

Open nickrsan opened 7 years ago

nickrsan commented 7 years ago

ftp:/data.ncdc.noaa.gov/cdr/ocean-atmos-props.

Suggested in a large email containing many urls

JeremiahCurtis commented 7 years ago

is this directory still working? my wget says no such directory

donbright commented 7 years ago

size estimate: 387 G (using lftp du -h)

@JeremiahCurtis it seems OK from here. sometimes i have forgotten to take that '.' off the end of what URLs @nickrsan posts, maybe that happened?

JeremiahCurtis commented 7 years ago

are there any zip files available? with my connection seemingly being throttled, it could take a very long time to grab 387 gb

donbright commented 7 years ago

attempting offline copy

nrdufour commented 7 years ago

Downloading and will be online at http://climate.nemoworld.info/data.ncdc.noaa.gov/cdr/ocean-atmos-props/ once complete.

nrdufour commented 7 years ago

Downloaded and available to http://climate.nemoworld.info/data.ncdc.noaa.gov/cdr/ocean-atmos-props/

bkirkbri commented 7 years ago

@nrdufour Thank you! Can you post hashdeep -erl ./data.ncdc.noaa.gov/cdr/ocean-atmos-props/ for cross verification? @donbright Did you get an offline copy? Can you post a hashdeep please?

donbright commented 7 years ago

@bkirkbri 119G downloaded, still in progress.

donbright commented 7 years ago

offline copy complete. 

Total: 30 directories, 10380 files, 0 symlinks                                 
New: 10380 files, 0 symlinks
415510918704 bytes transferred in 498468 seconds (814.0 KiB/s)
lftp data.ncdc.noaa.gov:/cdr/ocean-atmos-props>

Size from du -h is 387G

hashdeep offline, contact me if data is needed