search

climate-mirror / datasets

For tracking data mirroring progress
201 stars 18 forks source link

Dataset at ftp:/cddis.gsfc.nasa.gov/doris/ancillary #143

Open nickrsan opened 7 years ago

nickrsan commented 7 years ago

ftp:/cddis.gsfc.nasa.gov/doris/ancillary.

Suggested in a large email containing many urls

clickbg commented 7 years ago

Downloading

claughinghouse commented 7 years ago

Downloading.

clickbg commented 7 years ago

Now available at http://mirrors.sgate.org/climate-mirror/cddis.gsfc.nasa.gov/doris/ancillary/

donbright commented 7 years ago

size estimate: 21GB (from lftp du -h)

clickbg commented 7 years ago

root@zeus:/usr/local/www/climate-mirror # du -sh cddis.gsfc.nasa.gov/doris/ancillary/ 22G cddis.gsfc.nasa.gov/doris/ancillary/ root@zeus:/usr/local/www/climate-mirror # du -sm cddis.gsfc.nasa.gov/doris/ancillary/ 22550 cddis.gsfc.nasa.gov/doris/ancillary

bkirkbri commented 7 years ago

@clickbg Thank you. Would you post hashdeep -erl ./cddis.gsfc.nasa.gov/doris/ancillary/ output for cross verification with the next mirrorer?

jradzuweit commented 7 years ago

mirroring is just in progress at ftp://78.47.40.59/mirrors/cddis.gsfc.nasa.gov, will be online tomorrow under .

jradzuweit commented 7 years ago

Here the data, hashes also available (.sha256) ftp@sirius:~/mirrors> du -h -d4 cddis.gsfc.nasa.gov 19G cddis.gsfc.nasa.gov/doris/ancillary/quaternions/ja1 2.4G cddis.gsfc.nasa.gov/doris/ancillary/quaternions/ja2 250M cddis.gsfc.nasa.gov/doris/ancillary/quaternions/ja3 21G cddis.gsfc.nasa.gov/doris/ancillary/quaternions 21G cddis.gsfc.nasa.gov/doris/ancillary 21G cddis.gsfc.nasa.gov/doris 21G cddis.gsfc.nasa.gov 2.6M cddis.gsfc.nasa.gov.sha256

gabefair commented 7 years ago

I think I have a complete copy of this dataset

https://www.dropbox.com/sh/k7zwbodps7v27cr/AAChVXnrgobt9ZOcBtl1q_N7a?dl=0 Command used: wget -N -m ftp://cddis.gsfc.nasa.gov/doris/ancillary/*

Computed hashes using: hashdeep -erl ancillary/ > cddis_gsfc_nasa_gov_doris_ancillary_hashdeep-audit.txt https://www.dropbox.com/s/jfxs5flihlwakgn/cddis_gsfc_nasa_gov_doris_ancillary_hashdeep-audit.txt?dl=0

Results of du -b --max-depth=1 --human-readable: 21G ./quaternions 21G ./

gabefair commented 7 years ago

1 vote to close

Assuming my hashes are correct. @jradzuweit can you provide your sha256 hashes? We have it mirrored thrice in this ticket