search

climate-mirror / datasets

For tracking data mirroring progress
201 stars 18 forks source link

Dataset at ftp:/podaac-ftp.jpl.nasa.gov/allData/ccmp #189

Open nickrsan opened 7 years ago

nickrsan commented 7 years ago

ftp:/podaac-ftp.jpl.nasa.gov/allData/ccmp.

Suggested in a large email containing many urls

kitchenninja commented 7 years ago

Downloading now, but I don't have a way to publish online.

as-com commented 7 years ago

You can publish a torrent.

On Jan 28, 2017, 2:50 PM -0500, kitchenninja notifications@github.com, wrote:

Downloading now, but I don't have a way to publish online.

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub (https://github.com/climate-mirror/datasets/issues/189#issuecomment-275870310), or mute the thread (https://github.com/notifications/unsubscribe-auth/ADpIacV6gMBcmHT-NwK57ednlBPk0_kjks5rW5v4gaJpZM4LtK3r).

kitchenninja commented 7 years ago

Good idea, thanks!

donbright commented 7 years ago

size estimates: 

17G     ./L2.5                                                                 
102G    ./L3.0                                                                 
9.4G    ./L3.5a                                                                
0       ./L3.5b                                                         
128G    .total
bkirkbri commented 7 years ago

@kitchenninja Thanks! Please update when you have a complete mirror.

tkyocum commented 7 years ago

https://s3-us-west-1.amazonaws.com/podaac-ftp.jpl.nasa.gov/ccmp.tar.gz (128GB, 129GB uncompressed) https://s3-us-west-1.amazonaws.com/podaac-ftp.jpl.nasa.gov/ccmp.tar.gz.hashdeep

pkclsoft commented 7 years ago

Downloaded. Building a hashdeep report now.

pkclsoft commented 7 years ago

Does anyone have a hashdeep report I can use to compare with?

HostileGranola commented 7 years ago

@pkclsoft I am about to start pulling this data, do you still have it mirrored, and do you still have your hasdeep report?

pkclsoft commented 7 years ago

@HostileGranola I have a copy of that data. I wasn't able to find a way to make it public however. I can get the hashdeep report and make it public later today. I'll post a link here then.

HostileGranola commented 7 years ago

@pkclsoft No worries, none of my copies are public either. Thanks for that, I'll post my results and compare them to yours once I've finished copying the data. I'll let you know once that happens.

pkclsoft commented 7 years ago

The hashdeep I created is at: http://pkclsoft.com/downloads/podaac-ftp.jpl.nasa.gov.hashdeep

I believe there has been a tool created to assist with comparison:

https://github.com/climate-mirror/climate-mirror-tools/tree/master/hashdeep-diff

HostileGranola commented 7 years ago

Hashes are here

File sizes are here

I tried running ./hashdeep-diff --strip podaac-ftp.jpl.nasa.gov/allData/ccmp/ podaac-ftp.jpl.nasa.gov.pkclsoft.hashdeep .hashes.txt and it's giving me the following output: Failed diff at ./hashdeep-diff line 60.

HostileGranola commented 4 years ago

I no longer have this dataset due to storage space constraints. Apologies.