climate-mirror / datasets

For tracking data mirroring progress
201 stars 18 forks source link

NASA PODAAC Ocean Surface Current Analysis Real-time Data #251

Open nickrsan opened 7 years ago

nickrsan commented 7 years ago

ftp:/podaac-ftp.jpl.nasa.gov/allData/oscar.

Suggested in a large email containing many urls

sand500 commented 7 years ago

Working on this one.

mskallisti commented 7 years ago

Same.

sand500 commented 7 years ago

Finished downloading it.

donbright commented 7 years ago

size estimate : 42G

probable duplicate of #198

bkirkbri commented 7 years ago

@sand500 Thanks! Is your mirror public? Can you post find podaac-ftp.jpl.nasa.gov/allData/oscar/ -type f -exec md5sum {} \; | grep -v \\.listing | md5sum @mskallisti Please update when your mirror is complete. Thanks!

Grotax commented 7 years ago

Public Mirror: https://climate.grotax.de/podaac-ftp.jpl.nasa.gov/allData/oscar/ Checksums (hashdeep): https://climate.grotax.de/podaac-ftp.jpl.nasa.gov/allData/checksum-oscar.txt du -h:

4,0K    oscar/L4/resource/LAS/oscar_third_deg_180
8,0K    oscar/L4/resource/LAS
12K oscar/L4/resource
16K oscar/L4/oscar_1_deg/sw/Matlab
12K oscar/L4/oscar_1_deg/sw/idl
32K oscar/L4/oscar_1_deg/sw
1,2M    oscar/L4/oscar_1_deg/docs
725M    oscar/L4/oscar_1_deg
4,0K    oscar/L4/oscar_third_deg/sw/Matlab
4,0K    oscar/L4/oscar_third_deg/sw/idl
12K oscar/L4/oscar_third_deg/sw
4,0K    oscar/L4/oscar_third_deg/docs
37M oscar/L4/oscar_third_deg
762M    oscar/L4
28G oscar/preview/L4/resource/LAS/oscar_third_deg_180
28G oscar/preview/L4/resource/LAS
28G oscar/preview/L4/resource
16K oscar/preview/L4/oscar_third_deg/sw/Matlab
12K oscar/preview/L4/oscar_third_deg/sw/idl
32K oscar/preview/L4/oscar_third_deg/sw
124K    oscar/preview/L4/oscar_third_deg/docs
15G oscar/preview/L4/oscar_third_deg
42G oscar/preview/L4
42G oscar/preview
43G oscar/
markcaudill commented 7 years ago

The mirror links here are 404. Should this be reopened?

entr0p1 commented 7 years ago

Grabbing, just in case

Grotax commented 7 years ago

@markcaudill wrong syntax for links :( didn't get GitHub to display them correctly so I changed them to code for simple copy paste anyway mirror is still up and running

entr0p1 commented 7 years ago

Done

Checksums: https://gateway.ipfs.io/ipfs/QmdtqPeWmj2UzMaZgjYTydnR9Jg88cSsQ8mgQp49dvXuy5 Root Directory: https://gateway.ipfs.io/ipfs/QmcDJEAYmbjH8Yg1WKs2J3MoUNrJge8huA5yDQQ26xCNu8 Size: 42GB

# du -b --human-readable podaac-ftp.jpl.nasa.gov
21K     podaac-ftp.jpl.nasa.gov/allData/oscar/L4/oscar_1_deg/sw/idl
22K     podaac-ftp.jpl.nasa.gov/allData/oscar/L4/oscar_1_deg/sw/Matlab
59K     podaac-ftp.jpl.nasa.gov/allData/oscar/L4/oscar_1_deg/sw
1.2M    podaac-ftp.jpl.nasa.gov/allData/oscar/L4/oscar_1_deg/docs
733M    podaac-ftp.jpl.nasa.gov/allData/oscar/L4/oscar_1_deg
733M    podaac-ftp.jpl.nasa.gov/allData/oscar/L4
28G     podaac-ftp.jpl.nasa.gov/allData/oscar/preview/L4/resource/LAS/oscar_third_deg_180
28G     podaac-ftp.jpl.nasa.gov/allData/oscar/preview/L4/resource/LAS
28G     podaac-ftp.jpl.nasa.gov/allData/oscar/preview/L4/resource
21K     podaac-ftp.jpl.nasa.gov/allData/oscar/preview/L4/oscar_third_deg/sw/idl
22K     podaac-ftp.jpl.nasa.gov/allData/oscar/preview/L4/oscar_third_deg/sw/Matlab
59K     podaac-ftp.jpl.nasa.gov/allData/oscar/preview/L4/oscar_third_deg/sw
135K    podaac-ftp.jpl.nasa.gov/allData/oscar/preview/L4/oscar_third_deg/docs
14G     podaac-ftp.jpl.nasa.gov/allData/oscar/preview/L4/oscar_third_deg
42G     podaac-ftp.jpl.nasa.gov/allData/oscar/preview/L4
42G     podaac-ftp.jpl.nasa.gov/allData/oscar/preview
42G     podaac-ftp.jpl.nasa.gov/allData/oscar
42G     podaac-ftp.jpl.nasa.gov/allData
42G     podaac-ftp.jpl.nasa.gov