search

climate-mirror / datasets

For tracking data mirroring progress
201 stars 18 forks source link

Dataset at ftp://alt.ngs.noaa.gov/cors/rinex #138

Closed nickrsan closed 7 years ago

nickrsan commented 7 years ago

Primary server: ftp://geodesy.noaa.gov/cors/rinex Alternate server: ftp://alt.ngs.noaa.gov/cors/rinex

Global Navigation Satellite System (GNSS) data collected at these stations are made available to the public by NGS in Receiver INdependent EXchange (RINEX) format. https://www.ngs.noaa.gov/CORS/

stevelord commented 7 years ago

Currently downloading.

clickbg commented 7 years ago

Downloading as well.

gleezy commented 7 years ago

Downloading

gabefair commented 7 years ago

any success @stevelord , @clickbg , @gleezy ?

bkirkbri commented 7 years ago

Looks like @mxplusb is also downloading https://github.com/climate-mirror/datasets/issues/167#issuecomment-275196839

donbright commented 7 years ago

i have crashed my machines multiple times trying to get size estimates for big stuff like this. lftp literally runs out of memory causing itself to get killed.

bkirkbri commented 7 years ago

Size for just the 2016 directory is 4.3TB. There are directories from 1994 to 2016 and the older ones appear to be smaller. For example, 1994 is only 218MB.

bkirkbri commented 7 years ago

@mxplusb @clickbg @gleezy @stevelord Any luck with this one?

siennathesane commented 7 years ago

No, WinSCP failed as well. :/

gabefair commented 7 years ago

This data does not need to be backed up. While the cors superset does contain low priority meteorological data, this rinex dataset is not useful to our archive project as it mostly contains satellite orbit information for measuring stations. See: ftp://geodesy.noaa.gov/cors/README.txt

Thank you everyone for jumping on this. Please consider helping out with other tickets.