search

climate-mirror / datasets

For tracking data mirroring progress
201 stars 18 forks source link

NASA PODAAC Sea Surface Temperatures Data #242

Open nickrsan opened 7 years ago

nickrsan commented 7 years ago

ftp://podaac-ftp.jpl.nasa.gov/allData/goes.

Suggested in a large email containing many urls

lgreenlee commented 7 years ago

Downloading now

lgreenlee commented 7 years ago

Over 1.7TB, 42k/154k files complete

bkirkbri commented 7 years ago

@lgreenlee Thank you! Can you post a URL to your mirror? Also, hashdeep -erl ./podaac-ftp.jpl.nasa.gov/ is very helpful for cross-verification of mirrors.

ivanstegic commented 7 years ago

I am still downloading, and we're over 1TB at this point.

bkirkbri commented 7 years ago

@lgreenlee ping

bkirkbri commented 7 years ago

@ivanstegic has a copy of this one:

I have 1.5TB and it's live now at http://data.ourdataourhands.org/podaac-ftp.jpl.nasa.gov/

gabefair commented 7 years ago

@ivanstegic. You said you had a mirror at this post. What is the status of it? Can you give us the hashes so we can double check your files? hashdeep -erl . > podaac_ftp_jpl_nasa_gov_allData_goes_hash-audit.txt

ivanstegic commented 7 years ago

@gabefair the server is currently generating the hashes with hashdeep, you can see the file here: http://data.ourdataourhands.org/podaac-ftp.jpl.nasa.gov/podaac_ftp_jpl_nasa_gov_allData_goes_hash-audit.txt

It's in progress right now, so not complete, I can update this thread once the file is done.

jradzuweit commented 7 years ago

mirroring still running, it's dead slow at the moment I guess they reduce the speed on my IP. About 80 GB missing at the moment. I leave it running but at this speed it could take some more days :-(

ivanstegic commented 7 years ago

@gabefair deephash still running