lspestrip / striptease

Strip TEst Analysis for System Evaluation
MIT License
4 stars 3 forks source link

Improve the performance of the HDF5 storage database #62

Closed ziotom78 closed 2 years ago

ziotom78 commented 2 years ago

After a few trials, it appears that the original implementation of DataStorage is way too slow. This PR makes sure that when a DataStorage object is instantiated, it never tries to update the database if some information is missing. The price to pay is that the user might not «see» the newest HDF5 files that have been saved to disk.

For this purpose, I have created a new script, build_hdf5_database.py, which must be called whenever the database needs to be updated.