search

spedas / bleeding_edge

IDL-based Space Physics Environment Data Analysis Software (bleeding edge)
http://www.spedas.org
Other
7 stars 0 forks source link

Archive ASF and AST data at SPDF? #72

Open jameswilburlewis opened 1 year ago

jameswilburlewis commented 1 year ago

SPDF is asking if they should be archiving our AST and ASF data sets at CDAWeb. (Currently, only the ASK data is archived.)

I believe DOI's are in the process of being minted for AST and ASF, and Harald has been working on getting the SPASE metadata updated before he retires.

I think the reason they weren't archived from the beginning is the data volume for these products. If SPDF wants to host them, should we give them the green light?

jameswilburlewis commented 1 year ago

Tami has asked for an estimate of the data volume for all AST/ASF products to be archived. It sounds like SPDF is migrating to a different storage server, so the archival process will probably begin after the move is completed.

The current usage stats are:

ASF, AST, ASK: /disks/themisdata/thg/l1/asi : 90 TBytes Calgary red line imagers: /disks/themisdata/thg/l1/reg: 67 Tbytes ASI calibration: /disks/themisdata/thg/l2/asi: 715 Mbytes

jameswilburlewis commented 1 year ago

SPDF is willing to archive these data sets. It sounds like they are in the process of acquiring more storage, so it may be a few months before we need to set up and start the data transfer process.