NASA Multi-scale Ultra-high Resolution Sea Surface Temperature Data

[nickrsan]

ftp:/mariana.jpl.nasa.gov/mur_sst/tmchin.

Suggested in a large email containing many urls

[rustyguts]

I am mirroring. Good transfer speeds. Will Update with GDrive mirror

[rustyguts]

@mxplusb Can I take this one? Roughly 3TB mirror starting to download

[siennathesane]

@RustyGuts sure!

[rustyguts]

@mxplusb 12,000+ high resolution images in one directory. Should I zip these together before uploading? Google Drive is terrible with zipping on their end.

[siennathesane]

your call as it's your storage space.

[lrehmann]

Anyone is welcome to add files to this unlimited Google Drive Folder: https://drive.google.com/drive/folders/0B7i9iXoO2Jf_dVdOT2Vaanczb1U

[rustyguts]

@lrehmann I see you are at umich. I am not 8 miles away at emich pegging thier 1gbps line :)

[TwistTheNeil]

@RustyGuts If you could use lzma/7zip, that provides better compression!

[lrehmann]

@RustyGuts yeah, hopefully they won't mind me taking them for their word: http://google.umich.edu/tech-updates/newdriveforeducationwithunlimitedstorage And ideally, we won't need any of these backups...

[rustyguts]

@lrehmann I recall running some sort of query through the drive api to find most unlimited edu accounts are limited to 12TB. Not sure what happens when you hit that limit. If you don't mind, we can double mirror our folders together. I have quite a bit of uploading to do so it might be a while. Cheers

[as-com]

The legacy Google Drive API said 10 TB, but somewhere else I saw 1 PB or something insanely high.

Also, the folks at /r/DataHoarder have been storing massive amounts of data in unlimited GDrive accounts, so you should be fine.

On Wed, Jan 25, 2017 at 7:02 PM Brendan Kennedy notifications@github.com wrote:

@lrehmann https://github.com/lrehmann I recall running some sort of query through the drive api to find most unlimited edu accounts are limited to 12TB. Not sure what happens when you hit that limit. If you don't mind, we can double mirror our folders together. I have quite a bit of uploading to do so it might be a while. Cheers

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/climate-mirror/datasets/issues/235#issuecomment-275271705, or mute the thread https://github.com/notifications/unsubscribe-auth/ADpIaSKEabTH1OSguYYhFL7S14t9UtSLks5rV-KUgaJpZM4LtLA4 .

[rustyguts]

@as-com Thanks! That sub sent me here, great people over there.

[DiabolicalTMcD]

Pulling

[rustyguts]

Mirroring to Google Drive completed. About 3.2TB in total. Available Here

[bkirkbri]

@DiabolicalTMcD Did you get a copy of this one? Thanks!

[DiabolicalTMcD]

@bkirkbri My pull completed, but was 2.76 TB. Need to review the logs to see if some files failed. Still working on making available.

[DiabolicalTMcD]

@bkirkbri Failed to account for the compressed filesystem. du --apparent-size -ks reports 3078664730 so I think I have the full thing