search

SuperDARNCanada / data_flow

Scripts related to data flow and management
0 stars 3 forks source link

Is remove record redundant? #30

Open tjk584 opened 2 years ago

tjk584 commented 2 years ago

Recent changes to Borealis may have rendered remove_record.py redundant. This script takes a non-insignificant amount of time, and removing it would speed up the data flow and make it more efficient.

tjk584 commented 1 year ago

Records were removed from a file:

Converting /borealis_nfs/borealis_data/daily/20221226.0000.29.rkn.0.rawacf.hdf5.site
python3 remove_record.py 20221226.0000.29.rkn.0.rawacf.hdf5.site
Removed records from /borealis_nfs/borealis_data/daily/20221226.0000.29.rkn.0.rawacf.hdf5.site:

Perhaps remove record is still needed?