search

chime-experiment / dias

A data integrity framework
https://dias.readthedocs.io/
GNU General Public License v3.0
2 stars 0 forks source link

dataset analyzer: only acquisition path, not full name of flaginput file is printed #184

Open nritsche opened 3 years ago

nritsche commented 3 years ago

If the dataset analyzer finds a flags mismatch, it will print sth like

Jan 14 17:25:01 marimba dias[10721]: [2021-01-15 01:25:01,133] dias[dataset]: '/mnt/gong/staging/20201223T011000Z_chimestack_corr/01975038_0000.h5' file and '/mnt/gong/staging/20210101T000000Z_chime_flaginput' flaginput file: Flags don't match for dataset 3f7c8835997a7e2cb0d6a8c50080ab29.

But '/mnt/gong/staging/20210101T000000Z_chime_flaginput' is a path with multiple flaginput files:

$ ls /mnt/gong/staging/20210101T000000Z_chime_flaginput
00000156.h5  00259432.h5  00518625.h5  00777606.h5  01036926.h5
00086406.h5  00345725.h5  00604999.h5  00865373.h5  01123266.h5
00172806.h5  00432036.h5  00692525.h5  00950647.h5

the analyzer should print the full path + name of the file it was looking into.

nritsche commented 3 years ago

it would also be useful to print the flags update ID