rice-solar-physics / pydrad

Python tools for setting up HYDRAD runs and parsing output
https://pydrad.readthedocs.io
MIT License
4 stars 3 forks source link

Reformat all output to more efficient file format #96

Open wtbarnes opened 4 years ago

wtbarnes commented 4 years ago

When reading multiple time steps, it is not efficient to open, read, and close many ASCII files repeatedly. We should think about adding an optional first step to dump all output to something like HDF5 or Zarr to make repeated access much more efficient. Then, the Profile objects could read from that file (if it exists) and fall back to the usual ASCII file if not.