search

climate-mirror / datasets

For tracking data mirroring progress
201 stars 18 forks source link

Dataset at ftp:/data.nodc.noaa.gov/pub/data.nodc #158

Open nickrsan opened 7 years ago

nickrsan commented 7 years ago

ftp:/data.nodc.noaa.gov/pub/data.nodc.

Suggested in a large email containing many urls

defendr commented 7 years ago

Duplicated in https://github.com/climate-mirror/datasets/issues/122

erictapen commented 7 years ago

I'm currently mirroring this and plan to make a torrent out of this. Unfortunately I have no ideas how big this wil be. Can anyone with more knowledge about this kind of data give me a hint if it less than 300GB? Everything other would be a problem for me atm.

defendr commented 7 years ago

@erictapen Still downloading a full folder listing, but so far the following folder subset totals 268 GB:

Aquarius arcgis argo DeepwaterHorizon GCOS SMOS

Will post the complete size of all folders once I know. Argo itself has 3.5M files and counting...

defendr commented 7 years ago

@erictapen Total size is 359GB.

kenXengineering commented 7 years ago

I've started downloading aquarius, will host on Amazon Cloud Drive and IPFS.

erictapen commented 7 years ago

@defendr Thanks, I do not have this much space available atm. Will host some of the already uploaded torrents.

donbright commented 7 years ago

probable duplicate of #163

defendr commented 7 years ago

Completed this mirror -- it's available here: ftp://ftp.datadefendr.com/ Data from ftp://ftp.nodc.noaa.gov/pub/data.nodc/ is available as individual files.