chime-experiment / dias

A data integrity framework
https://dias.readthedocs.io/
GNU General Public License v3.0
2 stars 0 forks source link

feat(dataset): check that there are not valid frames with null dataset ids #194

Closed anjakefala closed 3 years ago

anjakefala commented 3 years ago

Dataset analyzer removes null dataset ids from its checks. It is important to check that null dataset ids are correctly assigned first.

This test results in 210212T193914Z_chimestack_corr/02015525_0000.h5 passing and 20210321T130426Z_chimestack_corr/00086522_0000.h5 failing.

Do we want to add more in-depth logging? List of dataset ids that failed the test, or the number of them that failed? Would that be helpful?