search

HERA-Team / hera_qm

HERA Data Quality Metrics
MIT License
2 stars 2 forks source link

Enable faster process_ex_ants using h5py directly #405

Closed jsdillon closed 2 years ago

jsdillon commented 2 years ago

process_ex_ants doesn't actually need to load entire metrics files, which can be quite slow when the metrics files are huge. This PR tries to use h5py to just extract the part of the file we actually need.

codecov[bot] commented 2 years ago

Codecov Report

Merging #405 (b45d8e5) into master (f3a02c3) will decrease coverage by 0.05%. The diff coverage is 64.28%.

Impacted file tree graph

@@            Coverage Diff             @@
##           master     #405      +/-   ##
==========================================
- Coverage   97.06%   97.01%   -0.06%     
==========================================
  Files          10       10              
  Lines        3306     3313       +7     
==========================================
+ Hits         3209     3214       +5     
- Misses         97       99       +2
Impacted Files Coverage Δ
hera_qm/metrics_io.py 91.84% <64.28%> (-0.31%) :arrow_down:

Continue to review full report at Codecov.

Legend - Click here to learn more Δ = absolute <relative> (impact), ø = not affected, ? = missing data Powered by Codecov. Last update f3a02c3...b45d8e5. Read the comment docs.