search

climate-mirror / datasets

For tracking data mirroring progress
201 stars 18 forks source link

Dataset at ftp:/umbra.nascom.nasa.gov/pub/yohkoh #221

Open nickrsan opened 7 years ago

nickrsan commented 7 years ago

ftp:/umbra.nascom.nasa.gov/pub/yohkoh.

Suggested in a large email containing many urls

emf commented 7 years ago

I'm mirroring this now.

siennathesane commented 7 years ago

@nickrsan can we get a clarification on what type of data this is? thanks!

I'll close it out once I know what type of data this is.

emf commented 7 years ago

Part of the dataset is .fits image files of solar flares. (the /pub/yohkoh/data/daily_images/ directory; completely downloaded) There's some other stuff in here I have no idea what it is, though. (the /pub/yohkoh/online_archive/ directory; in progress.)

emf commented 7 years ago

the online_archive stuff contains a bunch of binary files, headers look like: [...] 00000030 2c 01 00 00 88 04 00 00 52 45 46 4f 52 4d 41 54 |,.......REFORMAT| 00000040 32 2e 50 52 4f 00 00 00 32 39 2d 41 75 67 2d 31 |2.PRO...29-Aug-1| 00000050 39 39 32 30 35 3a 34 38 3a 34 33 1d ce 4e 00 13 |99205:48:43..N..| 00000060 12 ff 28 a8 00 13 12 40 bc 4e 00 13 12 68 3a a8 |..(....@.N...h:.| [...] if that looks familiar to anyone.

emf commented 7 years ago

ah. found it. ftp://sohoftp.nascom.nasa.gov/solarsoft/idlwww/yohkoh/reformat2.doc

emf commented 7 years ago

ftp://sohoftp.nascom.nasa.gov/solarsoft/idlwww/yohkoh/ completely mirrored.
that particular chunk has been posted to https://github.com/emf/sohoftp.nascom.nasa.gov-solarsoft-idlwww-yohkoh-

emf commented 7 years ago

I've posted a torrent for the daily_images. https://github.com/emf/climate-change-data-torrents/blob/master/umbra.nascom.nasa.gov-pub-yohkoh-data.torrent

it's small (1.2G).

I'm going to have to resize a volume to complete the online_archive section.. i'm at 42GB and nowhere near finished. it looks like it could be close to 1TB.