i4Ds / STIXCore

STIX Core functionalities
BSD 3-Clause "New" or "Revised" License
3 stars 3 forks source link

Missing fits files #398

Open samaloney opened 1 month ago

samaloney commented 1 month ago

Some TM has not been converted into fits files for various reasons this issue to track the overall progress on the analysis and resolution of these issues.

This table covers a list of currently missing L0 files based of of LB files created using the following script modified for each type

def missing_lb_l0(num):
    lb = Path(f'LB/21/6/{num}').glob("*.fits")
    l0 = Path(f'L0/21/6/{num}').glob("*.fits")
    lb_uid = [f.name.split('_')[-1] for f in lb] # extract UID-SEQ part
    l0_uid = [f.name.split('_')[-1] for f in l0]
    return set(lb_uid).difference(set(l0_uid))
Filename Incomplete DC Missing list Miss Type UID Error/reason
solo_LB_stix-21-6-21_0000000000-9999999999_V02_2112090002-51143.fits FALSE TRUE   2112090002 ValueError: cannot reshape array of size 154752 into shape (7,31,32,12)
solo_LB_stix-21-6-21_0000000000-9999999999_V02_2203151617-62310.fits FALSE TRUE   2203151617 bitstring.ReadError: Reading off the end of the data. Tried to read 8 bits when only 0 available.
solo_LB_stix-21-6-21_0000000000-9999999999_V02_2204028914-63370.fits FALSE TRUE   2204028914 ?
solo_LB_stix-21-6-21_0000000000-9999999999_V02_2209280787-63265.fits FALSE TRUE   2209280787 ?
solo_LB_stix-21-6-21_0000000000-9999999999_V02_0074661904-00000.fits FALSE FALSE   74661904 ?
solo_LB_stix-21-6-21_0000000000-9999999999_V02_2304131472-49403.fits FALSE TRUE   2304131472 ?
solo_LB_stix-21-6-21_0000000000-9999999999_V02_2305117159-57036.fits TRUE TRUE Cont 2305117159 ValueError: cannot reshape array of size 1974528 into shape (191,27,32,12)
solo_LB_stix-21-6-21_0000000000-9999999999_V02_2302120212-60797.fits FALSE TRUE   2302120212 ?
solo_LB_stix-21-6-21_0000000000-9999999999_V02_2302257105-61109.fits FALSE TRUE   2302257105 ?
solo_LB_stix-21-6-21_0000000000-9999999999_V02_2402287253-57269.fits TRUE TRUE Cont 2402287253 ValueError: cannot reshape array of size 4308096 into shape (661,17,32,12)
solo_LB_stix-21-6-21_0000000000-9999999999_V02_2403296400-62046.fits TRUE TRUE Cont 2403296400 ValueError: cannot reshape array of size 2324736 into shape (357,17,32,12)
solo_LB_stix-21-6-21_0000000000-9999999999_V02_2404042006-63069.fits FALSE TRUE   2404042006 ?
solo_LB_stix-21-6-21_0000000000-9999999999_V02_2404213657-64616.fits FALSE TRUE   2404213657 RID lookup: KeyError: 'No matches found for key 2404213657'
solo_LB_stix-21-6-21_0000000000-9999999999_V02_2405017696-64617.fits FALSE TRUE   2405017696 RID lookup: KeyError: 'No matches found for key 2405017696'
solo_LB_stix-21-6-21_0000000000-9999999999_V02_2404206759-64619.fits FALSE TRUE   2404206759 RID lookup: KeyError: 'No matches found for key 2404206759'
solo_LB_stix-21-6-21_0000000000-9999999999_V02_2405066983-64618.fits FALSE TRUE   2405066983 RID lookup: KeyError: 'No matches found for key 2405066983'
solo_LB_stix-21-6-21_0000000000-9999999999_V02_2404189403-64620.fits FALSE TRUE   2404189403 RID lookup: KeyError: 'No matches found for key 2405066983'
solo_LB_stix-21-6-21_0000000000-9999999999_V02_2404132170-64621.fits FALSE TRUE   2404132170 RID lookup: KeyError: 'No matches found for key 2404132170'
solo_LB_stix-21-6-21_0000000000-9999999999_V02_2407080920-55959.fits FALSE FALSE   2407080920 ValueError: cannot reshape array of size 43008 into shape (3,28,32,12)
           
solo_LB_stix-21-6-24_0000000000-9999999999_V02_2201270033-59178.fits TRUE FALSE First 2201270033 ValueError: cannot reshape array of size 43008 into shape (3,28,32,12)
solo_LB_stix-21-6-24_0000000000-9999999999_V02_2201260047-59172.fits FALSE FALSE   2201260047 ?
solo_LB_stix-21-6-24_0000000000-9999999999_V02_2201270032-59177.fits TRUE FALSE First 2201270032 ?
solo_LB_stix-21-6-24_0000000000-9999999999_V02_2307113758-59050.fits FALSE TRUE   2307113758 ?
solo_LB_stix-21-6-24_0000000000-9999999999_V02_2303248707-53119.fits FALSE TRUE   2303248707 ValueError: cannot reshape array of size 29 into shape (64,newaxis)
solo_LB_stix-21-6-24_0000000000-9999999999_V02_2303258858-53121.fits FALSE TRUE   2303258858 ValueError: cannot reshape array of size 29 into shape (64,newaxis)
solo_LB_stix-21-6-24_0000000000-9999999999_V02_2407196281-57017.fits TRUE FALSE Last 2407196281 Incomplete sequence <LevelB LB, 21, 6, 24 778565778:9102-778566616:27036>
solo_LB_stix-21-6-24_0000000000-9999999999_V02_2406115491-52941.fits FALSE FALSE   2406115491 _get_compression_scheme: AttributeError: 'PacketData' object has no attribute 'NIX00268'
solo_LB_stix-21-6-24_0000000000-9999999999_V02_2307117985-59051.fits FALSE TRUE   2307117985 ?
solo_LB_stix-21-6-24_0000000000-9999999999_V02_2209279737-62645.fits FALSE TRUE   2209279737 _get_compression_scheme: AttributeError: 'PacketData' object has no attribute 'NIX00268'
solo_LB_stix-21-6-24_0000000000-9999999999_V02_2406111879-52942.fits FALSE FALSE   2406111879 RID lookup: KeyError: 'No matches found for key 2406111879'
solo_LB_stix-21-6-24_0000000000-9999999999_V02_2303243039-53120.fits FALSE TRUE   2303243039 ValueError: cannot reshape array of size 29 into shape (64,newaxis)
solo_LB_stix-21-6-24_0000000000-9999999999_V02_2303251375-53122.fits FALSE TRUE   2303251375 ValueError: cannot reshape array of size 29 into shape (64,newaxis)