search

njcuk9999 / apero-drs

A PipelinE to Reduce Observations - The DRS for SPIRou (CFHT)
MIT License
12 stars 0 forks source link

Errors after the reduction of all calibrations : 19BQ10-Nov10 shape and wave failed (earthquake in the morning) (0.7.286) #713

Open larnoldgithub opened 1 year ago

larnoldgithub commented 1 year ago

02:31:12.875- |PROC| 02:31:12.891-@!|PROC| W[40-503-00019]: Error found for ID='1826' 02:31:12.929-@!|PROC| apero_shape_spirou.py 19BQ10-Nov10 2456221a_pp.fits 2456222a_pp.fits 2456223a_pp.fits 2456224a_pp.fits 2456225a_pp.fits 2456405a_pp.fits 2456406a_pp.fits 2456407a_pp.fits 2456408a_pp.fits 2456409a_pp.fits --crunfile=run_FullCalib_only.ini --program=SHAPE[01826] --recipe_kind=calib-night --shortname=SHAPE --parallel=True 02:31:12.945- |PROC| 02:31:12.959- |PROC| E[00-001-00054]: No good calibrations: 

    2456221a_pp.fits (FP_FP) METRIC=0.9863984046491702
    2456222a_pp.fits (FP_FP) METRIC=0.9863323433468489
    2456223a_pp.fits (FP_FP) METRIC=0.9863273066701727
    2456224a_pp.fits (FP_FP) METRIC=0.9863111006275848
    2456225a_pp.fits (FP_FP) METRIC=0.9863028552009329
    2456405a_pp.fits (FP_FP) METRIC=0.9862583847183283
    2456406a_pp.fits (FP_FP) METRIC=0.9860802532539256
    2456407a_pp.fits (FP_FP) METRIC=0.9859028355570758
    2456408a_pp.fits (FP_FP) METRIC=0.9858136208247197
    2456409a_pp.fits (FP_FP) METRIC=0.9857542515267715

02:31:13.075- |PROC| 02:31:13.092- |PROC| 02:31:13.108- |PROC| ***

02:31:13.383- |PROC| 02:31:13.393-@!|PROC| W[40-503-00019]: Error found for ID='3550' 02:31:13.416-@!|PROC| apero_wave_night_spirou.py 19BQ10-Nov10 --hcfiles 2456228c_pp.fits 2456229c_pp.fits 2456410c_pp.fits 2456411c_pp.fits --fpfiles 2456221a_pp.fits 2456222a_pp.fits 2456223a_pp.fits 2456224a_pp.fits 2456225a_pp.fits 2456405a_pp.fits 2456406a_pp.fits 2456407a_pp.fits 2456408a_pp.fits 2456409a_pp.fits --crunfile=run_FullCalib_only.ini --program=WAVE[03550] --recipe_kind=calib-night --shortname=WAVE --parallel=True 02:31:13.434- |PROC| 02:31:13.450- |PROC| E[00-001-00054]: No good calibrations: 

    2456221a_pp.fits (FP_FP) METRIC=0.9863984046491702
    2456222a_pp.fits (FP_FP) METRIC=0.9863323433468489
    2456223a_pp.fits (FP_FP) METRIC=0.9863273066701727
    2456224a_pp.fits (FP_FP) METRIC=0.9863111006275848
    2456225a_pp.fits (FP_FP) METRIC=0.9863028552009329
    2456405a_pp.fits (FP_FP) METRIC=0.9862583847183283
    2456406a_pp.fits (FP_FP) METRIC=0.9860802532539256
    2456407a_pp.fits (FP_FP) METRIC=0.9859028355570758
    2456408a_pp.fits (FP_FP) METRIC=0.9858136208247197
    2456409a_pp.fits (FP_FP) METRIC=0.9857542515267715

02:31:13.559- |PROC| 02:31:13.575- |PROC| 02:31:13.585- |PROC| ***

Reason for this error is likely the Earthquake that shifted the morning FP by 0.5pix (clear in a blink pm/am). Should I put the morning cals in the rejected odo list/database ? Maybe the best solution.

njcuk9999 commented 1 year ago

So this one always fails, it doesn't seem to be a problem as we have calibrations the day before and the day after. You are correct that we could add one set of the calibrations to the reject list to avoid this. We did have the question of which set (the AM or PM) should be rejected but seems like you are saying its the morning ones that should be rejected. If we don't want this error we can just reject those calibrations - as it is it will use the night before or after which isn't bad either.

larnoldgithub commented 1 year ago

The earthquake occured during the am calibrationq, just before the FP cals started. I'll move this morning cals set to the bad odo list.

larnoldgithub commented 1 year ago

Morning calibration files from 2456403f to 2456413a have been put in the rejected odometers list.
Reprocessing of the calibrations now works, using the full pm set and almost all flats from the morning.