search

climate-mirror / datasets

For tracking data mirroring progress
201 stars 18 forks source link

NASA PODAAC Sea Surface Salinity Data #257

Open nickrsan opened 7 years ago

nickrsan commented 7 years ago

ftp:/podaac-ftp.jpl.nasa.gov/allData/smap.

Suggested in a large email containing many urls

donbright commented 7 years ago

size estimate

+ lftp -c 'open ftp://podaac-ftp.jpl.nasa.gov/allData/smap && du -h -d1'
1.8M    ./docs                                                    
1.1T    ./L2                                                                   
4.5G    ./L3                                                                   
31K     ./sw                                                             
1.1T    .total
jradzuweit commented 7 years ago

started to create mirror at 78.47.40.59, will update when finished

bkirkbri commented 7 years ago

@jradzuweit Thanks! Please update when your mirror completes.

jradzuweit commented 7 years ago

I had to cancel, it's too large for my machine, sorry

wantonwonton commented 7 years ago

I just started a download of this (to be an offline copy).

gabefair commented 7 years ago

I have been downloading this one for a while. I will update when finished

tkyocum commented 7 years ago

1.1T total / 425G compressed

df34941bd546c098db770822ffa14de6 (find . -type f -exec md5sum {} \; | grep -v \.listing |md5sum)

https://s3-us-west-1.amazonaws.com/podaac-ftp.jpl.nasa.gov/smap.tar.gz (hey look, I got the filename right this time.)

gabefair commented 7 years ago

@bkirkbri I wasn't able to get all of it. Server is not allowing download of some datasets.

--2017-02-07 14:06:30-- ftp://podaac-ftp.jpl.nasa.gov/allData/smap/L2/RSS/V2/SCI/2016/272/RSS_smap_sss_L2C_r08866.nc => ‘podaac-ftp.jpl.nasa.gov/allData/smap/L2/RSS/V2/SCI/2016/272/RSS_smap_sss_L2C_r08866.nc’ ==> CWD not required. ==> PASV ... done. ==> RETR RSS_smap_sss_L2C_r08866.nc ... done. Length: 127001977 (121M)

80% [========================================================> ] 102,071,208 --.-K/s in 2m 12s

2017-02-07 14:08:43 (756 KB/s) - Control connection closed. Retrying.

--2017-02-07 14:08:44-- ftp://podaac-ftp.jpl.nasa.gov/allData/smap/L2/RSS/V2/SCI/2016/272/RSS_smap_sss_L2C_r08866.nc (try: 2) => ‘podaac-ftp.jpl.nasa.gov/allData/smap/L2/RSS/V2/SCI/2016/272/RSS_smap_sss_L2C_r08866.nc’ Connecting to podaac-ftp.jpl.nasa.gov (podaac-ftp.jpl.nasa.gov)|128.149.132.157|:21... failed: Network is unreachable. Resolving podaac-ftp.jpl.nasa.gov (podaac-ftp.jpl.nasa.gov)... failed: Name or service not known. wget: unable to resolve host address 'podaac-ftp.jpl.nasa.gov’

I have a copy of what I did get here: https://www.dropbox.com/sh/xw25xygkzl6k87z/AAA3ivKdOQcPQk6BSM5zXLC3a?dl=0

sarunasb commented 7 years ago

Downloading to geom.dartmouth.edu.

sarunasb commented 7 years ago

Mirror, checksums on geom.dartmouth.edu.