Closed guynir42 closed 1 year ago
If the output is an empty dataframe, it may be cheaper (dramatically) not to store any keys in the raw data file, instead of saving an empty dataframe which takes about 2mb, and may be slowing things down.
And make sure the observatory doesn't expect to have that empty dataframe in those files.
If the output is an empty dataframe, it may be cheaper (dramatically) not to store any keys in the raw data file, instead of saving an empty dataframe which takes about 2mb, and may be slowing things down.