guynir42 / AstroRetriever

A package used for downloading and processing images from various astronomical surveys
Other
4 stars 2 forks source link

Save empty HDF5 files #107

Closed guynir42 closed 1 year ago

guynir42 commented 1 year ago

If the output is an empty dataframe, it may be cheaper (dramatically) not to store any keys in the raw data file, instead of saving an empty dataframe which takes about 2mb, and may be slowing things down.

guynir42 commented 1 year ago

And make sure the observatory doesn't expect to have that empty dataframe in those files.