search

LM-SAL / aiapy

Python library for AIA data analysis
https://aiapy.readthedocs.io/en/stable/
BSD 3-Clause "New" or "Revised" License
6 stars 3 forks source link

Reformat emissivity genx files as HDF5 #70

Open nabobalis opened 3 years ago

nabobalis commented 3 years ago

In GitLab by @wtbarnes on Oct 13, 2020, 08:48

In order to use the emissivity files to calculate temperature response functions, they need to be reformatted as HDF5 files. They are currently in genx format and although we can read this format in Python via sunpy.io.special, the reader does not seem able to handle these files either because of their size or complexity. We also need to find a place to store these files so they can be downloaded as needed. Even sticking them directly into SSW would be sufficient.

This is not strictly related to the aiapy codebase as I do not anticipate this issue actually resulting in any code being added to aiapy or any code being modified. However, it is critical to #23 being resolved.

nabobalis commented 3 years ago

In GitLab by @wtbarnes on Oct 13, 2020, 08:51

This will block #23

nabobalis commented 3 years ago

In GitLab by @wtbarnes on Oct 13, 2020, 08:59

Some helpful bits of code:

When reading everything back into Python and double-checking things, I would suggest h5py

nabobalis commented 2 years ago

In GitLab by @wtbarnes on Sep 29, 2021, 07:44

Just to correct one of the statements above, I did actually manage to read one of these files with sunpy.io.special.read_genx. It just takes significantly longer than restgen in IDL, a little over 1 minute as compared to just a few seconds in IDL.