search

climate-mirror / datasets

For tracking data mirroring progress
201 stars 18 forks source link

Dataset at ftp:/ftp.cpc.ncep.noaa.gov/precip/global_CMORPH #161

Open nickrsan opened 7 years ago

nickrsan commented 7 years ago

ftp:/ftp.cpc.ncep.noaa.gov/precip/global_CMORPH.

Suggested in a large email containing many urls

donbright commented 7 years ago

standard anonymous login gives this

ftp> ls 550 Permission denied. ftp: bind: Address already in use

ghost commented 7 years ago

That's boilerplate, and invalid if interpreted that way. It is a public system. What's wrong is the posting of the boilerplate.

On Sun, Jan 29, 2017, at 21:59, don bright wrote:

got this message when trying to connect

don@miriam:/var/www/html$ ftp ftp.cpc.ncep.noaa.gov Connected to ftp- cpc.ncep.noaa.gov. 220- ** 220- WARNINGWARNINGWARNING 220-This is a United States (Agency) computer system, which may be accessed 220-and used only for official Government business by authorized personnel. 220-Unauthorized access or use of this computer system may subject violators 220-to criminal, civil, and/or administrative action.

standard anonymous login gives this

ftp> ls

550 Permission denied.

ftp: bind: Address already in use

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub[1], or mute the thread[2].

Links:

  1. https://github.com/climate-mirror/datasets/issues/161#issuecomment-275970876
  2. https://github.com/notifications/unsubscribe-auth/AD3HB38NFMtTuH80Xtwp3_vQInKKUgBCks5rXVH1gaJpZM4LtKyP
donbright commented 7 years ago

but are there any files to get? the system seems unresponsive...

bkirkbri commented 7 years ago

@donbright Looks like it available now:

lftp ftp.cpc.ncep.noaa.gov:/precip/global_CMORPH> du -h .
2.1G    ./3-hourly_025deg
4.0G    ./30min_025deg
16G     ./30min_8km
0       ./cmorph_temp
945M    ./daily_025deg
0       ./recovery/30min_8km
42M     ./recovery/daily_025deg
42M     ./recovery
23G     .
bkirkbri commented 7 years ago

Downloading now...

wantonwonton commented 7 years ago

I've just started a download as well (to be an offline copy).

bkirkbri commented 7 years ago

@wantonwonton Did you get a copy?

wantonwonton commented 7 years ago

Yes, my download finished. I have a hashdeep file (about 2MB compressed), but I don't have a convenient place to put it (unless I upload it as an attachment here). Any recommendations?

donbright commented 7 years ago

@wantonwonton if you have a public ssh key i can give you sftp / ssh access to my VM 67.205.151.30 and host a www folder there.

idea 2: create a github repository just for hashdeeps and do git add / git commit / git push for your hashdeeps. (possible problem... github file size limit is 100MB)

idea 3 : torrent your hashdeeps

idea 4: if they are small enough you could use something like pastebin (they are just text files after all)

wantonwonton commented 7 years ago

@donbright Thanks for the suggestions.

You can find my hashdeep results (compressed with bzip2) here.

bkirkbri commented 7 years ago

Completed and available at:

Index: https://s3.ca-central-1.amazonaws.com/climate-mirror/ftp.cpc.ncep.noaa.gov/ftp.cpc.ncep.noaa.gov_precip_global_CMORPH.index.html

Hashdeep: https://s3.ca-central-1.amazonaws.com/climate-mirror/ftp.cpc.ncep.noaa.gov/ftp.cpc.ncep.noaa.gov_precip_global_CMORPH.hashdeep.txt

Hashdeep signature: https://s3.ca-central-1.amazonaws.com/climate-mirror/ftp.cpc.ncep.noaa.gov/ftp.cpc.ncep.noaa.gov_precip_global_CMORPH.hashdeep.txt.asc

bkirkbri commented 7 years ago

@wantonwonton @donbright Thanks! I'll compare hashes tomorrow.