Keck-DataReductionPipelines / KCWI_DRP

KCWI python DRP
BSD 3-Clause "New" or "Revised" License
10 stars 14 forks source link

Data Reduction Pipeline not ingesting fits files, bokeh problem? #126

Closed shawnknabel closed 2 years ago

shawnknabel commented 2 years ago

Hi! Please help! :) Thank you for your time and patience.

I'm trying to reduce KCWI observations with the Python version of the KCWI DRP, which I installed from the https://kcwi-drp.readthedocs.io/en/latest/installing.html instructions. I've tried redownloading the data as well as installing the kcwidrp with the environment.yml file and alternatively by installing the dependencies manually. Some of the errors are different since I reinstalled with environment.yml file. Below is the latest attempt, where I have redownloaded the data and installed kcwidrp via the environment.yml file.

It first has a bokeh server error... then it tries to ingest the .fits files. I've listed the failures below and then pasted my terminal output, including showing the directory of files downloaded from the KCWI server.

1) The first fits file 00001.fits. Fails - Reason: unable to compute atlas resolution: grating undefined. "*** FILE TYPE is NOT determined. No processing is possible." In fits header, "Object" is listed as "TEST" 2) It then ingests files 00011.fits-00017.fits, which are the Biases that are output to the kcwi.proc file, which looks like this: | FRAMENO | CID | DID | TYPE | GRPID | TTIME | CAM | IFU | GRAT | GANG | CWAVE | BIN | FILT | MJD | STAGE | SUFF | OFNAME | TARGNAME | filename | | 11 | NONE | 1101009 | BIAS | 2021-08-13-11 | 0.0 | BLUE | Small | BL | 27.99 | 4599.87 | 1,1 | KBlue | 59439.085110 | 0 | RAW | kb210813_00011.fits | unknown | kb210813_00011.fits | | 12 | NONE | 1101009 | BIAS | 2021-08-13-11 | 0.0 | BLUE | Small | BL | 27.99 | 4599.87 | 1,1 | KBlue | 59439.087140 | 0 | RAW | kb210813_00012.fits | unknown | kb210813_00012.fits | | 13 | NONE | 1101009 | BIAS | 2021-08-13-11 | 0.0 | BLUE | Small | BL | 27.99 | 4599.87 | 1,1 | KBlue | 59439.089171 | 0 | RAW | kb210813_00013.fits | unknown | kb210813_00013.fits | | 14 | NONE | 1101009 | BIAS | 2021-08-13-11 | 0.0 | BLUE | Small | BL | 27.99 | 4599.87 | 1,1 | KBlue | 59439.091213 | 0 | RAW | kb210813_00014.fits | unknown | kb210813_00014.fits | | 15 | NONE | 1101009 | BIAS | 2021-08-13-11 | 0.0 | BLUE | Small | BL | 27.99 | 4599.87 | 1,1 | KBlue | 59439.093244 | 0 | RAW | kb210813_00015.fits | unknown | kb210813_00015.fits | | 16 | NONE | 1101009 | BIAS | 2021-08-13-11 | 0.0 | BLUE | Small | BL | 27.99 | 4599.87 | 1,1 | KBlue | 59439.095274 | 0 | RAW | kb210813_00016.fits | unknown | kb210813_00016.fits | | 17 | NONE | 1101009 | BIAS | 2021-08-13-11 | 0.0 | BLUE | Small | BL | 27.99 | 4599.87 | 1,1 | KBlue | 59439.097317 | 0 | RAW | kb210813_00017.fits | unknown | kb210813_00017.fits | 3) 00018.fits gives another "bokeh session error". In fits header, "Object" is 'CONT/FinBars/5.6 sec.' 4) 00019.fits and 00020.fits are ARCLAMP frames, says "Missing continuum bars". Fits header "Object" is 'FEAR/FlatA/40.0 sec.' and 'THAR/FlatA/80.0 sec.' 5) Next it ingests 00021.fits-00029.fits and 00048.fits, which are all flats and darks. They say "Missing master bias." 6) It tries to go through the "OBJECT" frames and wants that MBIAS:0, MFLAT: 0, AND ARCLAMP:0 Then it starts again at 00019.fits... repeats it all indefinitely!

##################### ------- from terminal ---------

(base) shawnknabel@scorza2:/data/raw_data/KECK_KCWI_SLACS_kinematics_shawn/2021aug13$ ls all_calibrations.csh kb210813_00014.fits kb210813_00031.fits kb210813_00048.fits aux kb210813_00015.fits kb210813_00032.fits kb210813_00049.fits dome_calibrations.csh kb210813_00016.fits kb210813_00033.fits kb210813_00050.fits generate_cal_files.csh kb210813_00017.fits kb210813_00034.fits kb210813_00051.fits kb210813_00001.fits kb210813_00018.fits kb210813_00035.fits kcas_calib_08-12-2021_04:01:27-PM.log kb210813_00002.fits kb210813_00019.fits kb210813_00036.fits kf210813_000001.fits kb210813_00003.fits kb210813_00020.fits kb210813_00037.fits kf210813_000002.fits kb210813_00004.fits kb210813_00021.fits kb210813_00038.fits kf210813_000003.fits kb210813_00005.fits kb210813_00022.fits kb210813_00039.fits magiq kb210813_00006.fits kb210813_00023.fits kb210813_00040.fits nodome_calibrations.csh kb210813_00007.fits kb210813_00024.fits kb210813_00041.fits 'restore_state_08-12-2021_04:00:52 PM.log' kb210813_00008.fits kb210813_00025.fits kb210813_00042.fits 'restore_state_08-12-2021_10:27:15 PM.log' kb210813_00009.fits kb210813_00026.fits kb210813_00043.fits U061_BL_small_4600.cal kb210813_00010.fits kb210813_00027.fits kb21081300044.fits U061BL_small_4600.state kb210813_00011.fits kb210813_00028.fits kb210813_00045.fits kb210813_00012.fits kb210813_00029.fits kb210813_00046.fits kb210813_00013.fits kb210813_00030.fits kb210813_00047.fits (base) shawnknabel@scorza2:/data/raw_data/KECK_KCWI_SLACS_kinematics_shawn/2021aug13$ source activate kcwidrp (kcwidrp) shawnknabel@scorza2:/data/raw_data/KECK_KCWI_SLACS_kinematics_shawn/2021aug13$ reduce_kcwi -f kb*.fits -g Directory logs has been created Directory plots has been created Directory redux has been created 2022-02-16 17:09:50:KCWI:INFO: proc table file not found: kcwi.proc 2022-02-16 17:09:50:DRPF:INFO: Framework initialized 2022-02-16 17:09:54:DRPF:INFO: Framework main loop started 2022-02-16 17:09:54:DRPF:ERROR: Exception Cannot pull session document because we failed to connect to the server (to start the server, try the 'bokeh serve' command) while invoking StartBokeh Traceback (most recent call last): File "/local/shawnknabel/anaconda3/envs/kcwidrp/lib/python3.7/site-packages/keckdrpframework/core/framework.py", line 229, in execute action_output = pipeline.get_action(action_name)(action, context) File "/local/shawnknabel/anaconda3/envs/kcwidrp/lib/python3.7/site-packages/keckdrpframework/pipelines/base_pipeline.py", line 84, in f return obj.apply() File "/local/shawnknabel/anaconda3/envs/kcwidrp/lib/python3.7/site-packages/keckdrpframework/primitives/base_primitive.py", line 57, in apply self.output = self._perform() File "/local/shawnknabel/anaconda3/envs/kcwidrp/lib/python3.7/site-packages/kcwidrp/primitives/StartBokeh.py", line 20, in _perform session = pull_session() File "/local/shawnknabel/anaconda3/envs/kcwidrp/lib/python3.7/site-packages/bokeh/client/session.py", line 119, in pull_session session.pull() File "/local/shawnknabel/anaconda3/envs/kcwidrp/lib/python3.7/site-packages/bokeh/client/session.py", line 348, in pull raise IOError("Cannot pull session document because we failed to connect to the server (to start the server, try the 'bokeh serve' command)") OSError: Cannot pull session document because we failed to connect to the server (to start the server, try the 'bokeh serve' command) 2022-02-16 17:09:54:DRPF:INFO: Event failed: name start_bokeh, action StartBokeh, arg name undef, recurr False 2022-02-16 17:09:54:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00001.fits, recurr False 2022-02-16 17:09:54:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00002.fits, recurr False 2022-02-16 17:09:54:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00003.fits, recurr False 2022-02-16 17:09:54:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00004.fits, recurr False 2022-02-16 17:09:54:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00005.fits, recurr False 2022-02-16 17:09:54:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00006.fits, recurr False 2022-02-16 17:09:54:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00007.fits, recurr False 2022-02-16 17:09:54:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00008.fits, recurr False 2022-02-16 17:09:54:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00009.fits, recurr False 2022-02-16 17:09:54:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00010.fits, recurr False 2022-02-16 17:09:54:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00011.fits, recurr False 2022-02-16 17:09:54:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00012.fits, recurr False 2022-02-16 17:09:54:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00013.fits, recurr False 2022-02-16 17:09:54:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00014.fits, recurr False 2022-02-16 17:09:54:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00015.fits, recurr False 2022-02-16 17:09:54:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00016.fits, recurr False 2022-02-16 17:09:54:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00017.fits, recurr False 2022-02-16 17:09:54:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00018.fits, recurr False 2022-02-16 17:09:54:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00019.fits, recurr False 2022-02-16 17:09:54:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00020.fits, recurr False 2022-02-16 17:09:54:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00021.fits, recurr False 2022-02-16 17:09:54:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00022.fits, recurr False 2022-02-16 17:09:54:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00023.fits, recurr False 2022-02-16 17:09:54:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00024.fits, recurr False 2022-02-16 17:09:54:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00025.fits, recurr False 2022-02-16 17:09:54:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00026.fits, recurr False 2022-02-16 17:09:54:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00027.fits, recurr False 2022-02-16 17:09:54:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00028.fits, recurr False 2022-02-16 17:09:54:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00029.fits, recurr False 2022-02-16 17:09:54:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00030.fits, recurr False 2022-02-16 17:09:54:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00031.fits, recurr False 2022-02-16 17:09:54:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00032.fits, recurr False 2022-02-16 17:09:54:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00033.fits, recurr False 2022-02-16 17:09:54:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00034.fits, recurr False 2022-02-16 17:09:54:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00035.fits, recurr False 2022-02-16 17:09:54:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00036.fits, recurr False 2022-02-16 17:09:54:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00037.fits, recurr False 2022-02-16 17:09:54:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00038.fits, recurr False 2022-02-16 17:09:54:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00039.fits, recurr False 2022-02-16 17:09:54:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00040.fits, recurr False 2022-02-16 17:09:54:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00041.fits, recurr False 2022-02-16 17:09:54:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00042.fits, recurr False 2022-02-16 17:09:54:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00043.fits, recurr False 2022-02-16 17:09:54:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00044.fits, recurr False 2022-02-16 17:09:54:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00045.fits, recurr False 2022-02-16 17:09:54:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00046.fits, recurr False 2022-02-16 17:09:54:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00047.fits, recurr False 2022-02-16 17:09:54:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00048.fits, recurr False 2022-02-16 17:09:54:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00049.fits, recurr False 2022-02-16 17:09:54:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00050.fits, recurr False 2022-02-16 17:09:54:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00051.fits, recurr False 2022-02-16 17:09:54:KCWI:INFO: ------------------- Ingesting file kb210813_00001.fits ------------------- 2022-02-16 17:09:54:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00001.fits 2022-02-16 17:09:54:KCWI:INFO: Looking for MBIAS frames 2022-02-16 17:09:54:KCWI:INFO: Camera is BLUE 2022-02-16 17:09:54:KCWI:INFO: Target type is MBIAS 2022-02-16 17:09:54:KCWI:INFO: Looking for frames with CCDCFG = 2201009 2022-02-16 17:09:54:KCWI:INFO: Looking for CONTBARS frames 2022-02-16 17:09:54:KCWI:INFO: Camera is BLUE 2022-02-16 17:09:54:KCWI:INFO: Target type is CONTBARS 2022-02-16 17:09:54:KCWI:INFO: Looking for frames with STATEID = 611471face9e2454ac394c13 (BL_medium) 2022-02-16 17:09:54:KCWI:INFO: Looking for MFLAT frames 2022-02-16 17:09:54:KCWI:INFO: Camera is BLUE 2022-02-16 17:09:54:KCWI:INFO: Target type is MFLAT 2022-02-16 17:09:54:KCWI:INFO: Looking for frames with STATEID = 611471face9e2454ac394c13 (BL_medium) 2022-02-16 17:09:54:KCWI:INFO: Looking for INVSENS frames 2022-02-16 17:09:54:KCWI:INFO: Camera is BLUE 2022-02-16 17:09:54:KCWI:INFO: Target type is INVSENS 2022-02-16 17:09:54:KCWI:INFO: Looking for frames with STATEID = 611471face9e2454ac394c13 (BL_medium) 2022-02-16 17:09:54:KCWI:INFO: Looking for ARCLAMP frames 2022-02-16 17:09:54:KCWI:INFO: Camera is BLUE 2022-02-16 17:09:54:KCWI:INFO: Target type is ARCLAMP 2022-02-16 17:09:54:KCWI:INFO: Looking for frames with STATEID = 611471face9e2454ac394c13 (BL_medium) 2022-02-16 17:09:54:KCWI:WARNING: UNABLE TO INGEST THE FILE 2022-02-16 17:09:54:KCWI:WARNING: Reason: unable to compute atlas resolution: grating undefined 2022-02-16 17:09:54:DRPF:INFO: Event failed: name next_file, action ingest_file, arg name kb210813_00001.fits, recurr False 2022-02-16 17:09:54:KCWI:WARNING: FILE TYPE is NOT determined. No processing is possible. 2022-02-16 17:09:54:DRPF:INFO: Event completed: name file_ingested, action action_planner, arg name kb210813_00001.fits, recurr False 2022-02-16 17:09:54:KCWI:INFO: ------------------- Ingesting file kb210813_00011.fits ------------------- 2022-02-16 17:09:55:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00011.fits 2022-02-16 17:09:55:KCWI:INFO: Looking for MBIAS frames 2022-02-16 17:09:55:KCWI:INFO: Camera is BLUE 2022-02-16 17:09:55:KCWI:INFO: Target type is MBIAS 2022-02-16 17:09:55:KCWI:INFO: Looking for frames with CCDCFG = 1101009 2022-02-16 17:09:55:KCWI:INFO: Looking for CONTBARS frames 2022-02-16 17:09:55:KCWI:INFO: Camera is BLUE 2022-02-16 17:09:55:KCWI:INFO: Target type is CONTBARS 2022-02-16 17:09:55:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-16 17:09:55:KCWI:INFO: Looking for MFLAT frames 2022-02-16 17:09:55:KCWI:INFO: Camera is BLUE 2022-02-16 17:09:55:KCWI:INFO: Target type is MFLAT 2022-02-16 17:09:55:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-16 17:09:55:KCWI:INFO: Looking for INVSENS frames 2022-02-16 17:09:55:KCWI:INFO: Camera is BLUE 2022-02-16 17:09:55:KCWI:INFO: Target type is INVSENS 2022-02-16 17:09:55:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-16 17:09:55:KCWI:INFO: Looking for ARCLAMP frames 2022-02-16 17:09:55:KCWI:INFO: Camera is BLUE 2022-02-16 17:09:55:KCWI:INFO: Target type is ARCLAMP 2022-02-16 17:09:55:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-16 17:09:55:DRPF:INFO: Event completed: name next_file, action ingest_file, arg name kb210813_00011.fits, recurr False 2022-02-16 17:09:55:KCWI:INFO: FILE TYPE DETERMINED AS BIAS 2022-02-16 17:09:55:KCWI:INFO: GROUPID is 2021-08-13-11 2022-02-16 17:09:55:KCWI:INFO: STATEID is Shared Bias (0) 2022-02-16 17:09:55:DRPF:INFO: Event completed: name file_ingested, action action_planner, arg name kb210813_00011.fits, recurr False 2022-02-16 17:09:55:DRPF:INFO: Event completed: name process_bias, action ProcessBias, arg name kb210813_00011.fits, recurr False 2022-02-16 17:09:55:KCWI:INFO: proctable updated with kb210813_00011.fits and kb210813_00011.fits 2022-02-16 17:09:55:KCWI:INFO: writing proc table file: kcwi.proc 2022-02-16 17:09:55:KCWI:INFO: Checking precondition for MakeMasterBias 2022-02-16 17:09:55:KCWI:INFO: Looking for BIAS frames 2022-02-16 17:09:55:KCWI:INFO: Camera is BLUE 2022-02-16 17:09:55:KCWI:INFO: Target type is BIAS 2022-02-16 17:09:55:KCWI:INFO: Looking for frames with CCDCFG = 1101009 2022-02-16 17:09:55:KCWI:INFO: Looking for frames with GRPID = 2021-08-13-11 2022-02-16 17:09:55:KCWI:INFO: pre condition got 1, expecting 7 2022-02-16 17:09:55:DRPF:INFO: Event failed: name bias_make_master, action MakeMasterBias, arg name kb210813_00011.fits, recurr False 2022-02-16 17:09:55:KCWI:INFO: ------------------- Ingesting file kb210813_00012.fits ------------------- 2022-02-16 17:09:55:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00012.fits 2022-02-16 17:09:55:KCWI:INFO: Looking for MBIAS frames 2022-02-16 17:09:55:KCWI:INFO: Camera is BLUE 2022-02-16 17:09:55:KCWI:INFO: Target type is MBIAS 2022-02-16 17:09:55:KCWI:INFO: Looking for frames with CCDCFG = 1101009 2022-02-16 17:09:55:KCWI:INFO: Looking for CONTBARS frames 2022-02-16 17:09:55:KCWI:INFO: Camera is BLUE 2022-02-16 17:09:55:KCWI:INFO: Target type is CONTBARS 2022-02-16 17:09:55:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-16 17:09:55:KCWI:INFO: Looking for MFLAT frames 2022-02-16 17:09:55:KCWI:INFO: Camera is BLUE 2022-02-16 17:09:55:KCWI:INFO: Target type is MFLAT 2022-02-16 17:09:55:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-16 17:09:55:KCWI:INFO: Looking for INVSENS frames 2022-02-16 17:09:55:KCWI:INFO: Camera is BLUE 2022-02-16 17:09:55:KCWI:INFO: Target type is INVSENS 2022-02-16 17:09:55:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-16 17:09:55:KCWI:INFO: Looking for ARCLAMP frames 2022-02-16 17:09:55:KCWI:INFO: Camera is BLUE 2022-02-16 17:09:55:KCWI:INFO: Target type is ARCLAMP 2022-02-16 17:09:55:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-16 17:09:55:DRPF:INFO: Event completed: name next_file, action ingest_file, arg name kb210813_00012.fits, recurr False 2022-02-16 17:09:55:KCWI:INFO: FILE TYPE DETERMINED AS BIAS 2022-02-16 17:09:55:KCWI:INFO: GROUPID is 2021-08-13-11 2022-02-16 17:09:55:KCWI:INFO: STATEID is Shared Bias (0) 2022-02-16 17:09:55:DRPF:INFO: Event completed: name file_ingested, action action_planner, arg name kb210813_00012.fits, recurr False 2022-02-16 17:09:55:DRPF:INFO: Event completed: name process_bias, action ProcessBias, arg name kb210813_00012.fits, recurr False 2022-02-16 17:09:55:KCWI:INFO: proctable updated with kb210813_00012.fits and kb210813_00012.fits 2022-02-16 17:09:55:KCWI:INFO: writing proc table file: kcwi.proc 2022-02-16 17:09:55:KCWI:INFO: Checking precondition for MakeMasterBias 2022-02-16 17:09:55:KCWI:INFO: Looking for BIAS frames 2022-02-16 17:09:55:KCWI:INFO: Camera is BLUE 2022-02-16 17:09:55:KCWI:INFO: Target type is BIAS 2022-02-16 17:09:55:KCWI:INFO: Looking for frames with CCDCFG = 1101009 2022-02-16 17:09:55:KCWI:INFO: Looking for frames with GRPID = 2021-08-13-11 2022-02-16 17:09:55:KCWI:INFO: pre condition got 2, expecting 7 2022-02-16 17:09:55:DRPF:INFO: Event failed: name bias_make_master, action MakeMasterBias, arg name kb210813_00012.fits, recurr False 2022-02-16 17:09:55:KCWI:INFO: ------------------- Ingesting file kb210813_00013.fits ------------------- 2022-02-16 17:09:56:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00013.fits 2022-02-16 17:09:56:KCWI:INFO: Looking for MBIAS frames 2022-02-16 17:09:56:KCWI:INFO: Camera is BLUE 2022-02-16 17:09:56:KCWI:INFO: Target type is MBIAS 2022-02-16 17:09:56:KCWI:INFO: Looking for frames with CCDCFG = 1101009 2022-02-16 17:09:56:KCWI:INFO: Looking for CONTBARS frames 2022-02-16 17:09:56:KCWI:INFO: Camera is BLUE 2022-02-16 17:09:56:KCWI:INFO: Target type is CONTBARS 2022-02-16 17:09:56:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-16 17:09:56:KCWI:INFO: Looking for MFLAT frames 2022-02-16 17:09:56:KCWI:INFO: Camera is BLUE 2022-02-16 17:09:56:KCWI:INFO: Target type is MFLAT 2022-02-16 17:09:56:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-16 17:09:56:KCWI:INFO: Looking for INVSENS frames 2022-02-16 17:09:56:KCWI:INFO: Camera is BLUE 2022-02-16 17:09:56:KCWI:INFO: Target type is INVSENS 2022-02-16 17:09:56:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-16 17:09:56:KCWI:INFO: Looking for ARCLAMP frames 2022-02-16 17:09:56:KCWI:INFO: Camera is BLUE 2022-02-16 17:09:56:KCWI:INFO: Target type is ARCLAMP 2022-02-16 17:09:56:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-16 17:09:56:DRPF:INFO: Event completed: name next_file, action ingest_file, arg name kb210813_00013.fits, recurr False 2022-02-16 17:09:56:KCWI:INFO: FILE TYPE DETERMINED AS BIAS 2022-02-16 17:09:56:KCWI:INFO: GROUPID is 2021-08-13-11 2022-02-16 17:09:56:KCWI:INFO: STATEID is Shared Bias (0) 2022-02-16 17:09:56:DRPF:INFO: Event completed: name file_ingested, action action_planner, arg name kb210813_00013.fits, recurr False 2022-02-16 17:09:56:DRPF:INFO: Event completed: name process_bias, action ProcessBias, arg name kb210813_00013.fits, recurr False 2022-02-16 17:09:56:KCWI:INFO: proctable updated with kb210813_00013.fits and kb210813_00013.fits 2022-02-16 17:09:56:KCWI:INFO: writing proc table file: kcwi.proc 2022-02-16 17:09:56:KCWI:INFO: Checking precondition for MakeMasterBias 2022-02-16 17:09:56:KCWI:INFO: Looking for BIAS frames 2022-02-16 17:09:56:KCWI:INFO: Camera is BLUE 2022-02-16 17:09:56:KCWI:INFO: Target type is BIAS 2022-02-16 17:09:56:KCWI:INFO: Looking for frames with CCDCFG = 1101009 2022-02-16 17:09:56:KCWI:INFO: Looking for frames with GRPID = 2021-08-13-11 2022-02-16 17:09:56:KCWI:INFO: pre condition got 3, expecting 7 2022-02-16 17:09:56:DRPF:INFO: Event failed: name bias_make_master, action MakeMasterBias, arg name kb210813_00013.fits, recurr False 2022-02-16 17:09:56:KCWI:INFO: ------------------- Ingesting file kb210813_00014.fits ------------------- 2022-02-16 17:09:56:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00014.fits 2022-02-16 17:09:56:KCWI:INFO: Looking for MBIAS frames 2022-02-16 17:09:56:KCWI:INFO: Camera is BLUE 2022-02-16 17:09:56:KCWI:INFO: Target type is MBIAS 2022-02-16 17:09:56:KCWI:INFO: Looking for frames with CCDCFG = 1101009 2022-02-16 17:09:56:KCWI:INFO: Looking for CONTBARS frames 2022-02-16 17:09:56:KCWI:INFO: Camera is BLUE 2022-02-16 17:09:56:KCWI:INFO: Target type is CONTBARS 2022-02-16 17:09:56:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-16 17:09:56:KCWI:INFO: Looking for MFLAT frames 2022-02-16 17:09:56:KCWI:INFO: Camera is BLUE 2022-02-16 17:09:56:KCWI:INFO: Target type is MFLAT 2022-02-16 17:09:56:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-16 17:09:56:KCWI:INFO: Looking for INVSENS frames 2022-02-16 17:09:56:KCWI:INFO: Camera is BLUE 2022-02-16 17:09:56:KCWI:INFO: Target type is INVSENS 2022-02-16 17:09:56:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-16 17:09:56:KCWI:INFO: Looking for ARCLAMP frames 2022-02-16 17:09:56:KCWI:INFO: Camera is BLUE 2022-02-16 17:09:56:KCWI:INFO: Target type is ARCLAMP 2022-02-16 17:09:56:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-16 17:09:56:DRPF:INFO: Event completed: name next_file, action ingest_file, arg name kb210813_00014.fits, recurr False 2022-02-16 17:09:56:KCWI:INFO: FILE TYPE DETERMINED AS BIAS 2022-02-16 17:09:56:KCWI:INFO: GROUPID is 2021-08-13-11 2022-02-16 17:09:56:KCWI:INFO: STATEID is Shared Bias (0) 2022-02-16 17:09:56:DRPF:INFO: Event completed: name file_ingested, action action_planner, arg name kb210813_00014.fits, recurr False 2022-02-16 17:09:56:DRPF:INFO: Event completed: name process_bias, action ProcessBias, arg name kb210813_00014.fits, recurr False 2022-02-16 17:09:56:KCWI:INFO: proctable updated with kb210813_00014.fits and kb210813_00014.fits 2022-02-16 17:09:56:KCWI:INFO: writing proc table file: kcwi.proc 2022-02-16 17:09:56:KCWI:INFO: Checking precondition for MakeMasterBias 2022-02-16 17:09:56:KCWI:INFO: Looking for BIAS frames 2022-02-16 17:09:56:KCWI:INFO: Camera is BLUE 2022-02-16 17:09:56:KCWI:INFO: Target type is BIAS 2022-02-16 17:09:56:KCWI:INFO: Looking for frames with CCDCFG = 1101009 2022-02-16 17:09:56:KCWI:INFO: Looking for frames with GRPID = 2021-08-13-11 2022-02-16 17:09:56:KCWI:INFO: pre condition got 4, expecting 7 2022-02-16 17:09:56:DRPF:INFO: Event failed: name bias_make_master, action MakeMasterBias, arg name kb210813_00014.fits, recurr False 2022-02-16 17:09:56:KCWI:INFO: ------------------- Ingesting file kb210813_00015.fits ------------------- 2022-02-16 17:09:56:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00015.fits 2022-02-16 17:09:56:KCWI:INFO: Looking for MBIAS frames 2022-02-16 17:09:56:KCWI:INFO: Camera is BLUE 2022-02-16 17:09:56:KCWI:INFO: Target type is MBIAS 2022-02-16 17:09:56:KCWI:INFO: Looking for frames with CCDCFG = 1101009 2022-02-16 17:09:56:KCWI:INFO: Looking for CONTBARS frames 2022-02-16 17:09:56:KCWI:INFO: Camera is BLUE 2022-02-16 17:09:56:KCWI:INFO: Target type is CONTBARS 2022-02-16 17:09:56:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-16 17:09:56:KCWI:INFO: Looking for MFLAT frames 2022-02-16 17:09:56:KCWI:INFO: Camera is BLUE 2022-02-16 17:09:56:KCWI:INFO: Target type is MFLAT 2022-02-16 17:09:56:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-16 17:09:56:KCWI:INFO: Looking for INVSENS frames 2022-02-16 17:09:56:KCWI:INFO: Camera is BLUE 2022-02-16 17:09:56:KCWI:INFO: Target type is INVSENS 2022-02-16 17:09:56:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-16 17:09:56:KCWI:INFO: Looking for ARCLAMP frames 2022-02-16 17:09:56:KCWI:INFO: Camera is BLUE 2022-02-16 17:09:56:KCWI:INFO: Target type is ARCLAMP 2022-02-16 17:09:56:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-16 17:09:56:DRPF:INFO: Event completed: name next_file, action ingest_file, arg name kb210813_00015.fits, recurr False 2022-02-16 17:09:56:KCWI:INFO: FILE TYPE DETERMINED AS BIAS 2022-02-16 17:09:56:KCWI:INFO: GROUPID is 2021-08-13-11 2022-02-16 17:09:56:KCWI:INFO: STATEID is Shared Bias (0) 2022-02-16 17:09:56:DRPF:INFO: Event completed: name file_ingested, action action_planner, arg name kb210813_00015.fits, recurr False 2022-02-16 17:09:56:DRPF:INFO: Event completed: name process_bias, action ProcessBias, arg name kb210813_00015.fits, recurr False 2022-02-16 17:09:56:KCWI:INFO: proctable updated with kb210813_00015.fits and kb210813_00015.fits 2022-02-16 17:09:56:KCWI:INFO: writing proc table file: kcwi.proc 2022-02-16 17:09:56:KCWI:INFO: Checking precondition for MakeMasterBias 2022-02-16 17:09:56:KCWI:INFO: Looking for BIAS frames 2022-02-16 17:09:56:KCWI:INFO: Camera is BLUE 2022-02-16 17:09:56:KCWI:INFO: Target type is BIAS 2022-02-16 17:09:56:KCWI:INFO: Looking for frames with CCDCFG = 1101009 2022-02-16 17:09:56:KCWI:INFO: Looking for frames with GRPID = 2021-08-13-11 2022-02-16 17:09:56:KCWI:INFO: pre condition got 5, expecting 7 2022-02-16 17:09:56:DRPF:INFO: Event failed: name bias_make_master, action MakeMasterBias, arg name kb210813_00015.fits, recurr False 2022-02-16 17:09:56:KCWI:INFO: ------------------- Ingesting file kb210813_00016.fits ------------------- 2022-02-16 17:09:57:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00016.fits 2022-02-16 17:09:57:KCWI:INFO: Looking for MBIAS frames 2022-02-16 17:09:57:KCWI:INFO: Camera is BLUE 2022-02-16 17:09:57:KCWI:INFO: Target type is MBIAS 2022-02-16 17:09:57:KCWI:INFO: Looking for frames with CCDCFG = 1101009 2022-02-16 17:09:57:KCWI:INFO: Looking for CONTBARS frames 2022-02-16 17:09:57:KCWI:INFO: Camera is BLUE 2022-02-16 17:09:57:KCWI:INFO: Target type is CONTBARS 2022-02-16 17:09:57:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-16 17:09:57:KCWI:INFO: Looking for MFLAT frames 2022-02-16 17:09:57:KCWI:INFO: Camera is BLUE 2022-02-16 17:09:57:KCWI:INFO: Target type is MFLAT 2022-02-16 17:09:57:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-16 17:09:57:KCWI:INFO: Looking for INVSENS frames 2022-02-16 17:09:57:KCWI:INFO: Camera is BLUE 2022-02-16 17:09:57:KCWI:INFO: Target type is INVSENS 2022-02-16 17:09:57:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-16 17:09:57:KCWI:INFO: Looking for ARCLAMP frames 2022-02-16 17:09:57:KCWI:INFO: Camera is BLUE 2022-02-16 17:09:57:KCWI:INFO: Target type is ARCLAMP 2022-02-16 17:09:57:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-16 17:09:57:DRPF:INFO: Event completed: name next_file, action ingest_file, arg name kb210813_00016.fits, recurr False 2022-02-16 17:09:57:KCWI:INFO: FILE TYPE DETERMINED AS BIAS 2022-02-16 17:09:57:KCWI:INFO: GROUPID is 2021-08-13-11 2022-02-16 17:09:57:KCWI:INFO: STATEID is Shared Bias (0) 2022-02-16 17:09:57:DRPF:INFO: Event completed: name file_ingested, action action_planner, arg name kb210813_00016.fits, recurr False 2022-02-16 17:09:57:DRPF:INFO: Event completed: name process_bias, action ProcessBias, arg name kb210813_00016.fits, recurr False 2022-02-16 17:09:57:KCWI:INFO: proctable updated with kb210813_00016.fits and kb210813_00016.fits 2022-02-16 17:09:57:KCWI:INFO: writing proc table file: kcwi.proc 2022-02-16 17:09:57:KCWI:INFO: Checking precondition for MakeMasterBias 2022-02-16 17:09:57:KCWI:INFO: Looking for BIAS frames 2022-02-16 17:09:57:KCWI:INFO: Camera is BLUE 2022-02-16 17:09:57:KCWI:INFO: Target type is BIAS 2022-02-16 17:09:57:KCWI:INFO: Looking for frames with CCDCFG = 1101009 2022-02-16 17:09:57:KCWI:INFO: Looking for frames with GRPID = 2021-08-13-11 2022-02-16 17:09:57:KCWI:INFO: pre condition got 6, expecting 7 2022-02-16 17:09:57:DRPF:INFO: Event failed: name bias_make_master, action MakeMasterBias, arg name kb210813_00016.fits, recurr False 2022-02-16 17:09:57:KCWI:INFO: ------------------- Ingesting file kb210813_00017.fits ------------------- 2022-02-16 17:09:57:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00017.fits 2022-02-16 17:09:57:KCWI:INFO: Looking for MBIAS frames 2022-02-16 17:09:57:KCWI:INFO: Camera is BLUE 2022-02-16 17:09:57:KCWI:INFO: Target type is MBIAS 2022-02-16 17:09:57:KCWI:INFO: Looking for frames with CCDCFG = 1101009 2022-02-16 17:09:57:KCWI:INFO: Looking for CONTBARS frames 2022-02-16 17:09:57:KCWI:INFO: Camera is BLUE 2022-02-16 17:09:57:KCWI:INFO: Target type is CONTBARS 2022-02-16 17:09:57:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-16 17:09:57:KCWI:INFO: Looking for MFLAT frames 2022-02-16 17:09:57:KCWI:INFO: Camera is BLUE 2022-02-16 17:09:57:KCWI:INFO: Target type is MFLAT 2022-02-16 17:09:57:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-16 17:09:57:KCWI:INFO: Looking for INVSENS frames 2022-02-16 17:09:57:KCWI:INFO: Camera is BLUE 2022-02-16 17:09:57:KCWI:INFO: Target type is INVSENS 2022-02-16 17:09:57:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-16 17:09:57:KCWI:INFO: Looking for ARCLAMP frames 2022-02-16 17:09:57:KCWI:INFO: Camera is BLUE 2022-02-16 17:09:57:KCWI:INFO: Target type is ARCLAMP 2022-02-16 17:09:57:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-16 17:09:57:DRPF:INFO: Event completed: name next_file, action ingest_file, arg name kb210813_00017.fits, recurr False 2022-02-16 17:09:57:KCWI:INFO: FILE TYPE DETERMINED AS BIAS 2022-02-16 17:09:57:KCWI:INFO: GROUPID is 2021-08-13-11 2022-02-16 17:09:57:KCWI:INFO: STATEID is Shared Bias (0) 2022-02-16 17:09:57:DRPF:INFO: Event completed: name file_ingested, action action_planner, arg name kb210813_00017.fits, recurr False 2022-02-16 17:09:57:DRPF:INFO: Event completed: name process_bias, action ProcessBias, arg name kb210813_00017.fits, recurr False 2022-02-16 17:09:57:KCWI:INFO: proctable updated with kb210813_00017.fits and kb210813_00017.fits 2022-02-16 17:09:57:KCWI:INFO: writing proc table file: kcwi.proc 2022-02-16 17:09:57:KCWI:INFO: Checking precondition for MakeMasterBias 2022-02-16 17:09:57:KCWI:INFO: Looking for BIAS frames 2022-02-16 17:09:57:KCWI:INFO: Camera is BLUE 2022-02-16 17:09:57:KCWI:INFO: Target type is BIAS 2022-02-16 17:09:57:KCWI:INFO: Looking for frames with CCDCFG = 1101009 2022-02-16 17:09:57:KCWI:INFO: Looking for frames with GRPID = 2021-08-13-11 2022-02-16 17:09:57:KCWI:INFO: pre condition got 7, expecting 7 2022-02-16 17:09:57:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00011.fits 2022-02-16 17:09:57:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00012.fits 2022-02-16 17:09:57:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00013.fits 2022-02-16 17:09:58:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00014.fits 2022-02-16 17:09:58:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00015.fits 2022-02-16 17:09:58:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00016.fits 2022-02-16 17:09:58:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00017.fits 2022-02-16 17:10:07:KCWI:INFO: Amp1 read noise from bias in e-: 3.049 2022-02-16 17:10:07:DRPF:ERROR: Exception 'ProcessingContext' object has no attribute 'bokeh_session' while invoking MakeMasterBias Traceback (most recent call last): File "/local/shawnknabel/anaconda3/envs/kcwidrp/lib/python3.7/site-packages/keckdrpframework/core/framework.py", line 229, in execute action_output = pipeline.get_action(action_name)(action, context) File "/local/shawnknabel/anaconda3/envs/kcwidrp/lib/python3.7/site-packages/keckdrpframework/pipelines/base_pipeline.py", line 84, in f return obj.apply() File "/local/shawnknabel/anaconda3/envs/kcwidrp/lib/python3.7/site-packages/keckdrpframework/primitives/base_primitive.py", line 57, in apply self.output = self._perform() File "/local/shawnknabel/anaconda3/envs/kcwidrp/lib/python3.7/site-packages/kcwidrp/primitives/MakeMasterBias.py", line 126, in _perform bokeh_plot(p, self.context.bokeh_session) AttributeError: 'ProcessingContext' object has no attribute 'bokeh_session' 2022-02-16 17:10:07:DRPF:INFO: Event failed: name bias_make_master, action MakeMasterBias, arg name kb210813_00017.fits, recurr False 2022-02-16 17:10:07:KCWI:INFO: ------------------- Ingesting file kb210813_00018.fits ------------------- 2022-02-16 17:10:07:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00018.fits 2022-02-16 17:10:07:KCWI:INFO: Looking for MBIAS frames 2022-02-16 17:10:07:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:07:KCWI:INFO: Target type is MBIAS 2022-02-16 17:10:07:KCWI:INFO: Looking for frames with CCDCFG = 1111000 2022-02-16 17:10:07:KCWI:INFO: Looking for CONTBARS frames 2022-02-16 17:10:07:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:07:KCWI:INFO: Target type is CONTBARS 2022-02-16 17:10:07:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-16 17:10:07:KCWI:INFO: Looking for MFLAT frames 2022-02-16 17:10:07:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:07:KCWI:INFO: Target type is MFLAT 2022-02-16 17:10:07:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-16 17:10:07:KCWI:INFO: Looking for INVSENS frames 2022-02-16 17:10:07:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:07:KCWI:INFO: Target type is INVSENS 2022-02-16 17:10:07:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-16 17:10:07:KCWI:INFO: Looking for ARCLAMP frames 2022-02-16 17:10:07:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:07:KCWI:INFO: Target type is ARCLAMP 2022-02-16 17:10:07:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-16 17:10:07:DRPF:INFO: Event completed: name next_file, action ingest_file, arg name kb210813_00018.fits, recurr False 2022-02-16 17:10:07:KCWI:INFO: FILE TYPE DETERMINED AS CONTBARS 2022-02-16 17:10:07:KCWI:INFO: GROUPID is 2021-08-13-18 2022-02-16 17:10:07:KCWI:INFO: *** STATEID is BL_small_4600 (6115c23cce9e240a4bee8190) 2022-02-16 17:10:07:DRPF:INFO: Event completed: name file_ingested, action action_planner, arg name kb210813_00018.fits, recurr False 2022-02-16 17:10:07:DRPF:INFO: Event completed: name process_contbars, action ProcessContbars, arg name kb210813_00018.fits, recurr False 2022-02-16 17:10:07:KCWI:INFO: Amp1 Read noise from oscan in e-: 3.687 2022-02-16 17:10:07:DRPF:ERROR: Exception 'ProcessingContext' object has no attribute 'bokeh_session' while invoking SubtractOverscan Traceback (most recent call last): File "/local/shawnknabel/anaconda3/envs/kcwidrp/lib/python3.7/site-packages/keckdrpframework/core/framework.py", line 229, in execute action_output = pipeline.get_action(action_name)(action, context) File "/local/shawnknabel/anaconda3/envs/kcwidrp/lib/python3.7/site-packages/keckdrpframework/pipelines/base_pipeline.py", line 84, in f return obj.apply() File "/local/shawnknabel/anaconda3/envs/kcwidrp/lib/python3.7/site-packages/keckdrpframework/primitives/base_primitive.py", line 57, in apply self.output = self._perform() File "/local/shawnknabel/anaconda3/envs/kcwidrp/lib/python3.7/site-packages/kcwidrp/primitives/SubtractOverscan.py", line 77, in _perform bokeh_plot(p, self.context.bokeh_session) AttributeError: 'ProcessingContext' object has no attribute 'bokeh_session' 2022-02-16 17:10:07:DRPF:INFO: Event failed: name contbar_subtract_overscan, action SubtractOverscan, arg name kb210813_00018.fits, recurr False 2022-02-16 17:10:07:KCWI:INFO: ------------------- Ingesting file kb210813_00019.fits ------------------- 2022-02-16 17:10:08:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00019.fits 2022-02-16 17:10:08:KCWI:INFO: Looking for MBIAS frames 2022-02-16 17:10:08:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:08:KCWI:INFO: Target type is MBIAS 2022-02-16 17:10:08:KCWI:INFO: Looking for frames with CCDCFG = 1111000 2022-02-16 17:10:08:KCWI:INFO: Looking for CONTBARS frames 2022-02-16 17:10:08:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:08:KCWI:INFO: Target type is CONTBARS 2022-02-16 17:10:08:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-16 17:10:08:KCWI:INFO: Looking for MFLAT frames 2022-02-16 17:10:08:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:08:KCWI:INFO: Target type is MFLAT 2022-02-16 17:10:08:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-16 17:10:08:KCWI:INFO: Looking for INVSENS frames 2022-02-16 17:10:08:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:08:KCWI:INFO: Target type is INVSENS 2022-02-16 17:10:08:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-16 17:10:08:KCWI:INFO: Looking for ARCLAMP frames 2022-02-16 17:10:08:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:08:KCWI:INFO: Target type is ARCLAMP 2022-02-16 17:10:08:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-16 17:10:08:KCWI:WARNING: Cannot reduce ARCLAMP frame. Missing continuum bars. Rescheduling for later. 2022-02-16 17:10:08:DRPF:INFO: Event failed: name next_file, action ingest_file, arg name kb210813_00019.fits, recurr True 2022-02-16 17:10:08:KCWI:INFO: ------------------- Ingesting file kb210813_00020.fits ------------------- 2022-02-16 17:10:08:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00020.fits 2022-02-16 17:10:08:KCWI:INFO: Looking for MBIAS frames 2022-02-16 17:10:08:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:08:KCWI:INFO: Target type is MBIAS 2022-02-16 17:10:08:KCWI:INFO: Looking for frames with CCDCFG = 1111000 2022-02-16 17:10:08:KCWI:INFO: Looking for CONTBARS frames 2022-02-16 17:10:08:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:08:KCWI:INFO: Target type is CONTBARS 2022-02-16 17:10:08:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-16 17:10:08:KCWI:INFO: Looking for MFLAT frames 2022-02-16 17:10:08:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:08:KCWI:INFO: Target type is MFLAT 2022-02-16 17:10:08:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-16 17:10:08:KCWI:INFO: Looking for INVSENS frames 2022-02-16 17:10:08:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:08:KCWI:INFO: Target type is INVSENS 2022-02-16 17:10:08:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-16 17:10:08:KCWI:INFO: Looking for ARCLAMP frames 2022-02-16 17:10:08:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:08:KCWI:INFO: Target type is ARCLAMP 2022-02-16 17:10:08:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-16 17:10:08:KCWI:WARNING: Cannot reduce ARCLAMP frame. Missing continuum bars. Rescheduling for later. 2022-02-16 17:10:08:DRPF:INFO: Event failed: name next_file, action ingest_file, arg name kb210813_00020.fits, recurr True 2022-02-16 17:10:08:KCWI:INFO: ------------------- Ingesting file kb210813_00021.fits ------------------- 2022-02-16 17:10:08:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00021.fits 2022-02-16 17:10:08:KCWI:INFO: Looking for MBIAS frames 2022-02-16 17:10:08:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:08:KCWI:INFO: Target type is MBIAS 2022-02-16 17:10:08:KCWI:INFO: Looking for frames with CCDCFG = 1101009 2022-02-16 17:10:08:KCWI:INFO: Looking for CONTBARS frames 2022-02-16 17:10:08:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:08:KCWI:INFO: Target type is CONTBARS 2022-02-16 17:10:08:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-16 17:10:08:KCWI:INFO: Looking for MFLAT frames 2022-02-16 17:10:08:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:08:KCWI:INFO: Target type is MFLAT 2022-02-16 17:10:08:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-16 17:10:08:KCWI:INFO: Looking for INVSENS frames 2022-02-16 17:10:08:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:08:KCWI:INFO: Target type is INVSENS 2022-02-16 17:10:08:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-16 17:10:08:KCWI:INFO: Looking for ARCLAMP frames 2022-02-16 17:10:08:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:08:KCWI:INFO: Target type is ARCLAMP 2022-02-16 17:10:08:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-16 17:10:08:KCWI:WARNING: Cannot reduce FLATLAMP frame. Missing master bias. Rescheduling for later. 2022-02-16 17:10:08:DRPF:INFO: Event failed: name next_file, action ingest_file, arg name kb210813_00021.fits, recurr True 2022-02-16 17:10:08:KCWI:INFO: ------------------- Ingesting file kb210813_00022.fits ------------------- 2022-02-16 17:10:09:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00022.fits 2022-02-16 17:10:09:KCWI:INFO: Looking for MBIAS frames 2022-02-16 17:10:09:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:09:KCWI:INFO: Target type is MBIAS 2022-02-16 17:10:09:KCWI:INFO: Looking for frames with CCDCFG = 1101009 2022-02-16 17:10:09:KCWI:INFO: Looking for CONTBARS frames 2022-02-16 17:10:09:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:09:KCWI:INFO: Target type is CONTBARS 2022-02-16 17:10:09:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-16 17:10:09:KCWI:INFO: Looking for MFLAT frames 2022-02-16 17:10:09:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:09:KCWI:INFO: Target type is MFLAT 2022-02-16 17:10:09:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-16 17:10:09:KCWI:INFO: Looking for INVSENS frames 2022-02-16 17:10:09:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:09:KCWI:INFO: Target type is INVSENS 2022-02-16 17:10:09:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-16 17:10:09:KCWI:INFO: Looking for ARCLAMP frames 2022-02-16 17:10:09:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:09:KCWI:INFO: Target type is ARCLAMP 2022-02-16 17:10:09:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-16 17:10:09:KCWI:WARNING: Cannot reduce FLATLAMP frame. Missing master bias. Rescheduling for later. 2022-02-16 17:10:09:DRPF:INFO: Event failed: name next_file, action ingest_file, arg name kb210813_00022.fits, recurr True 2022-02-16 17:10:09:KCWI:INFO: ------------------- Ingesting file kb210813_00023.fits ------------------- 2022-02-16 17:10:09:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00023.fits 2022-02-16 17:10:09:KCWI:INFO: Looking for MBIAS frames 2022-02-16 17:10:09:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:09:KCWI:INFO: Target type is MBIAS 2022-02-16 17:10:09:KCWI:INFO: Looking for frames with CCDCFG = 1101009 2022-02-16 17:10:09:KCWI:INFO: Looking for CONTBARS frames 2022-02-16 17:10:09:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:09:KCWI:INFO: Target type is CONTBARS 2022-02-16 17:10:09:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-16 17:10:09:KCWI:INFO: Looking for MFLAT frames 2022-02-16 17:10:09:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:09:KCWI:INFO: Target type is MFLAT 2022-02-16 17:10:09:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-16 17:10:09:KCWI:INFO: Looking for INVSENS frames 2022-02-16 17:10:09:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:09:KCWI:INFO: Target type is INVSENS 2022-02-16 17:10:09:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-16 17:10:09:KCWI:INFO: Looking for ARCLAMP frames 2022-02-16 17:10:09:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:09:KCWI:INFO: Target type is ARCLAMP 2022-02-16 17:10:09:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-16 17:10:09:KCWI:WARNING: Cannot reduce FLATLAMP frame. Missing master bias. Rescheduling for later. 2022-02-16 17:10:09:DRPF:INFO: Event failed: name next_file, action ingest_file, arg name kb210813_00023.fits, recurr True 2022-02-16 17:10:09:KCWI:INFO: ------------------- Ingesting file kb210813_00024.fits ------------------- 2022-02-16 17:10:10:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00024.fits 2022-02-16 17:10:10:KCWI:INFO: Looking for MBIAS frames 2022-02-16 17:10:10:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:10:KCWI:INFO: Target type is MBIAS 2022-02-16 17:10:10:KCWI:INFO: Looking for frames with CCDCFG = 1101009 2022-02-16 17:10:10:KCWI:INFO: Looking for CONTBARS frames 2022-02-16 17:10:10:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:10:KCWI:INFO: Target type is CONTBARS 2022-02-16 17:10:10:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-16 17:10:10:KCWI:INFO: Looking for MFLAT frames 2022-02-16 17:10:10:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:10:KCWI:INFO: Target type is MFLAT 2022-02-16 17:10:10:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-16 17:10:10:KCWI:INFO: Looking for INVSENS frames 2022-02-16 17:10:10:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:10:KCWI:INFO: Target type is INVSENS 2022-02-16 17:10:10:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-16 17:10:10:KCWI:INFO: Looking for ARCLAMP frames 2022-02-16 17:10:10:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:10:KCWI:INFO: Target type is ARCLAMP 2022-02-16 17:10:10:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-16 17:10:10:KCWI:WARNING: Cannot reduce FLATLAMP frame. Missing master bias. Rescheduling for later. 2022-02-16 17:10:10:DRPF:INFO: Event failed: name next_file, action ingest_file, arg name kb210813_00024.fits, recurr True 2022-02-16 17:10:10:KCWI:INFO: ------------------- Ingesting file kb210813_00025.fits ------------------- 2022-02-16 17:10:10:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00025.fits 2022-02-16 17:10:10:KCWI:INFO: Looking for MBIAS frames 2022-02-16 17:10:10:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:10:KCWI:INFO: Target type is MBIAS 2022-02-16 17:10:10:KCWI:INFO: Looking for frames with CCDCFG = 1101009 2022-02-16 17:10:10:KCWI:INFO: Looking for CONTBARS frames 2022-02-16 17:10:10:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:10:KCWI:INFO: Target type is CONTBARS 2022-02-16 17:10:10:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-16 17:10:10:KCWI:INFO: Looking for MFLAT frames 2022-02-16 17:10:10:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:10:KCWI:INFO: Target type is MFLAT 2022-02-16 17:10:10:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-16 17:10:10:KCWI:INFO: Looking for INVSENS frames 2022-02-16 17:10:10:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:10:KCWI:INFO: Target type is INVSENS 2022-02-16 17:10:10:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-16 17:10:10:KCWI:INFO: Looking for ARCLAMP frames 2022-02-16 17:10:10:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:10:KCWI:INFO: Target type is ARCLAMP 2022-02-16 17:10:10:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-16 17:10:10:KCWI:WARNING: Cannot reduce FLATLAMP frame. Missing master bias. Rescheduling for later. 2022-02-16 17:10:10:DRPF:INFO: Event failed: name next_file, action ingest_file, arg name kb210813_00025.fits, recurr True 2022-02-16 17:10:10:KCWI:INFO: ------------------- Ingesting file kb210813_00026.fits ------------------- 2022-02-16 17:10:10:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00026.fits 2022-02-16 17:10:10:KCWI:INFO: Looking for MBIAS frames 2022-02-16 17:10:10:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:10:KCWI:INFO: Target type is MBIAS 2022-02-16 17:10:10:KCWI:INFO: Looking for frames with CCDCFG = 1101009 2022-02-16 17:10:10:KCWI:INFO: Looking for CONTBARS frames 2022-02-16 17:10:10:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:10:KCWI:INFO: Target type is CONTBARS 2022-02-16 17:10:10:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-16 17:10:10:KCWI:INFO: Looking for MFLAT frames 2022-02-16 17:10:10:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:10:KCWI:INFO: Target type is MFLAT 2022-02-16 17:10:10:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-16 17:10:10:KCWI:INFO: Looking for INVSENS frames 2022-02-16 17:10:10:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:10:KCWI:INFO: Target type is INVSENS 2022-02-16 17:10:10:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-16 17:10:10:KCWI:INFO: Looking for ARCLAMP frames 2022-02-16 17:10:10:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:10:KCWI:INFO: Target type is ARCLAMP 2022-02-16 17:10:10:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-16 17:10:10:KCWI:WARNING: Cannot reduce FLATLAMP frame. Missing master bias. Rescheduling for later. 2022-02-16 17:10:10:DRPF:INFO: Event failed: name next_file, action ingest_file, arg name kb210813_00026.fits, recurr True 2022-02-16 17:10:10:KCWI:INFO: ------------------- Ingesting file kb210813_00027.fits ------------------- 2022-02-16 17:10:11:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00027.fits 2022-02-16 17:10:11:KCWI:INFO: Looking for MBIAS frames 2022-02-16 17:10:11:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:11:KCWI:INFO: Target type is MBIAS 2022-02-16 17:10:11:KCWI:INFO: Looking for frames with CCDCFG = 1101009 2022-02-16 17:10:11:KCWI:INFO: Looking for CONTBARS frames 2022-02-16 17:10:11:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:11:KCWI:INFO: Target type is CONTBARS 2022-02-16 17:10:11:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-16 17:10:11:KCWI:INFO: Looking for MFLAT frames 2022-02-16 17:10:11:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:11:KCWI:INFO: Target type is MFLAT 2022-02-16 17:10:11:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-16 17:10:11:KCWI:INFO: Looking for INVSENS frames 2022-02-16 17:10:11:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:11:KCWI:INFO: Target type is INVSENS 2022-02-16 17:10:11:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-16 17:10:11:KCWI:INFO: Looking for ARCLAMP frames 2022-02-16 17:10:11:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:11:KCWI:INFO: Target type is ARCLAMP 2022-02-16 17:10:11:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-16 17:10:11:KCWI:WARNING: Cannot reduce DOMEFLAT frame. Missing master bias. Rescheduling for later. 2022-02-16 17:10:11:DRPF:INFO: Event failed: name next_file, action ingest_file, arg name kb210813_00027.fits, recurr True 2022-02-16 17:10:11:KCWI:INFO: ------------------- Ingesting file kb210813_00028.fits ------------------- 2022-02-16 17:10:11:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00028.fits 2022-02-16 17:10:11:KCWI:INFO: Looking for MBIAS frames 2022-02-16 17:10:11:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:11:KCWI:INFO: Target type is MBIAS 2022-02-16 17:10:11:KCWI:INFO: Looking for frames with CCDCFG = 1101009 2022-02-16 17:10:11:KCWI:INFO: Looking for CONTBARS frames 2022-02-16 17:10:11:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:11:KCWI:INFO: Target type is CONTBARS 2022-02-16 17:10:11:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-16 17:10:11:KCWI:INFO: Looking for MFLAT frames 2022-02-16 17:10:11:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:11:KCWI:INFO: Target type is MFLAT 2022-02-16 17:10:11:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-16 17:10:11:KCWI:INFO: Looking for INVSENS frames 2022-02-16 17:10:11:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:11:KCWI:INFO: Target type is INVSENS 2022-02-16 17:10:11:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-16 17:10:11:KCWI:INFO: Looking for ARCLAMP frames 2022-02-16 17:10:11:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:11:KCWI:INFO: Target type is ARCLAMP 2022-02-16 17:10:11:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-16 17:10:11:KCWI:WARNING: Cannot reduce DOMEFLAT frame. Missing master bias. Rescheduling for later. 2022-02-16 17:10:11:DRPF:INFO: Event failed: name next_file, action ingest_file, arg name kb210813_00028.fits, recurr True 2022-02-16 17:10:11:KCWI:INFO: ------------------- Ingesting file kb210813_00029.fits ------------------- 2022-02-16 17:10:11:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00029.fits 2022-02-16 17:10:11:KCWI:INFO: Looking for MBIAS frames 2022-02-16 17:10:11:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:11:KCWI:INFO: Target type is MBIAS 2022-02-16 17:10:11:KCWI:INFO: Looking for frames with CCDCFG = 1101009 2022-02-16 17:10:11:KCWI:INFO: Looking for CONTBARS frames 2022-02-16 17:10:11:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:11:KCWI:INFO: Target type is CONTBARS 2022-02-16 17:10:11:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-16 17:10:11:KCWI:INFO: Looking for MFLAT frames 2022-02-16 17:10:11:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:11:KCWI:INFO: Target type is MFLAT 2022-02-16 17:10:11:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-16 17:10:11:KCWI:INFO: Looking for INVSENS frames 2022-02-16 17:10:11:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:11:KCWI:INFO: Target type is INVSENS 2022-02-16 17:10:11:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-16 17:10:11:KCWI:INFO: Looking for ARCLAMP frames 2022-02-16 17:10:11:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:11:KCWI:INFO: Target type is ARCLAMP 2022-02-16 17:10:11:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-16 17:10:11:KCWI:WARNING: Cannot reduce DOMEFLAT frame. Missing master bias. Rescheduling for later. 2022-02-16 17:10:11:DRPF:INFO: Event failed: name next_file, action ingest_file, arg name kb210813_00029.fits, recurr True 2022-02-16 17:10:11:KCWI:INFO: ------------------- Ingesting file kb210813_00048.fits ------------------- 2022-02-16 17:10:12:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00048.fits 2022-02-16 17:10:12:KCWI:INFO: Looking for MBIAS frames 2022-02-16 17:10:12:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:12:KCWI:INFO: Target type is MBIAS 2022-02-16 17:10:12:KCWI:INFO: Looking for frames with CCDCFG = 1101009 2022-02-16 17:10:12:KCWI:INFO: Looking for CONTBARS frames 2022-02-16 17:10:12:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:12:KCWI:INFO: Target type is CONTBARS 2022-02-16 17:10:12:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-16 17:10:12:KCWI:INFO: Looking for MFLAT frames 2022-02-16 17:10:12:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:12:KCWI:INFO: Target type is MFLAT 2022-02-16 17:10:12:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-16 17:10:12:KCWI:INFO: Looking for INVSENS frames 2022-02-16 17:10:12:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:12:KCWI:INFO: Target type is INVSENS 2022-02-16 17:10:12:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-16 17:10:12:KCWI:INFO: Looking for ARCLAMP frames 2022-02-16 17:10:12:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:12:KCWI:INFO: Target type is ARCLAMP 2022-02-16 17:10:12:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-16 17:10:12:KCWI:WARNING: Cannot reduce TWIFLAT frame. Missing master bias. Rescheduling for later. 2022-02-16 17:10:12:DRPF:INFO: Event failed: name next_file, action ingest_file, arg name kb210813_00048.fits, recurr True 2022-02-16 17:10:12:KCWI:INFO: ------------------- Ingesting file kb210813_00031.fits ------------------- 2022-02-16 17:10:12:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00031.fits 2022-02-16 17:10:12:KCWI:INFO: Looking for MBIAS frames 2022-02-16 17:10:12:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:12:KCWI:INFO: Target type is MBIAS 2022-02-16 17:10:12:KCWI:INFO: Looking for frames with CCDCFG = 1101009 2022-02-16 17:10:12:KCWI:INFO: Looking for CONTBARS frames 2022-02-16 17:10:12:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:12:KCWI:INFO: Target type is CONTBARS 2022-02-16 17:10:12:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-16 17:10:12:KCWI:INFO: Looking for MFLAT frames 2022-02-16 17:10:12:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:12:KCWI:INFO: Target type is MFLAT 2022-02-16 17:10:12:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-16 17:10:12:KCWI:INFO: Looking for INVSENS frames 2022-02-16 17:10:12:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:12:KCWI:INFO: Target type is INVSENS 2022-02-16 17:10:12:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-16 17:10:12:KCWI:INFO: Looking for ARCLAMP frames 2022-02-16 17:10:12:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:12:KCWI:INFO: Target type is ARCLAMP 2022-02-16 17:10:12:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-16 17:10:12:KCWI:WARNING: Cannot reduce OBJECT frame. Rescheduling for later. Found: 2022-02-16 17:10:12:KCWI:WARNING: MBIAS: 0 2022-02-16 17:10:12:KCWI:WARNING: MFLAT: 0 2022-02-16 17:10:12:KCWI:WARNING: ARCLAMP: 0 2022-02-16 17:10:12:DRPF:INFO: Event failed: name next_file, action ingest_file, arg name kb210813_00031.fits, recurr True 2022-02-16 17:10:12:KCWI:INFO: ------------------- Ingesting file kb210813_00032.fits ------------------- 2022-02-16 17:10:13:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00032.fits 2022-02-16 17:10:13:KCWI:INFO: Looking for MBIAS frames 2022-02-16 17:10:13:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:13:KCWI:INFO: Target type is MBIAS 2022-02-16 17:10:13:KCWI:INFO: Looking for frames with CCDCFG = 1101009 2022-02-16 17:10:13:KCWI:INFO: Looking for CONTBARS frames 2022-02-16 17:10:13:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:13:KCWI:INFO: Target type is CONTBARS 2022-02-16 17:10:13:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-16 17:10:13:KCWI:INFO: Looking for MFLAT frames 2022-02-16 17:10:13:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:13:KCWI:INFO: Target type is MFLAT 2022-02-16 17:10:13:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-16 17:10:13:KCWI:INFO: Looking for INVSENS frames 2022-02-16 17:10:13:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:13:KCWI:INFO: Target type is INVSENS 2022-02-16 17:10:13:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-16 17:10:13:KCWI:INFO: Looking for ARCLAMP frames 2022-02-16 17:10:13:KCWI:INFO: Camera is BLUE 2022-02-16 17:10:13:KCWI:INFO: Target type is ARCLAMP 2022-02-16 17:10:13:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-16 17:10:13:KCWI:WARNING: Cannot reduce OBJECT frame. Rescheduling for later. Found: 2022-02-16 17:10:13:KCWI:WARNING: MBIAS: 0 2022-02-16 17:10:13:KCWI:WARNING: MFLAT: 0 2022-02-16 17:10:13:KCWI:WARNING: ARCLAMP: 0 2022-02-16 17:10:13:DRPF:INFO: Event failed: name next_file, action ingest_file, arg name kb210813_00032.fits, recurr True

... repeat!

MNBrod commented 2 years ago

Could you try turning plotting all the way off in the config file? This can be done by

  1. Copying the kcwi.cfg file from /kcwidrp/configs/kcwi.cfg to your machine.
  2. Modifying the enable_bokeh parameter to false
  3. Saving that file
  4. Running the pipeline with an additional -c flag pointing to the file you just saved.

This appears to be a plotting issue, which this will confirm (if it works that is). I will spend some time trying to recreate your issue to give you more useful help and get back to you here.

shawnknabel commented 2 years ago

Thanks for the response!

I've copied the config file to the directory given below and set enable_bokeh to "False". Then ran the following line in the directory with the night's data: reduce_kcwi -f kb*.fits -g -c /local/shawnknabel/kcwi.cfg

It still gives similar errors.

Did I do that correctly?

shawnknabel commented 2 years ago

Hi, just following up. The proposed solution did not solve my problem. Have you had any luck recreating my issue or have any other ideas? Thanks!

MNBrod commented 2 years ago

Sorry! I've spent a little while trying to recreate this, but haven't succeeded. It is possible that the false is case sensitive, although I don't think that's the source of the problem (still worth trying though).

Otherwise, there appears to be a general problem with the Bokeh install. If you run bokeh serve, do you get something along the lines of

2022-02-22 12:45:48,292 Starting Bokeh server version 2.2.3 (running on Tornado 6.1)
2022-02-22 12:45:48,296 User authentication hooks NOT provided (default user enabled)
shawnknabel commented 2 years ago

No problem! Thank you.

I updated bokeh to version 2.4.2 (it was 2.0.2) and changed the config line to false. Here's what bokeh serve gives

2022-02-22 15:02:52,313 Starting Bokeh server version 2.4.2 (running on Tornado 6.1) 2022-02-22 15:02:52,314 User authentication hooks NOT provided (default user enabled) 2022-02-22 15:02:52,315 Bokeh app running at: http://localhost:5006/ 2022-02-22 15:02:52,315 Starting Bokeh server with process id: 432375

Then I ran the pipeline, and the bokeh error disappeared. Here's what I have now, which I have seen before.

(kcwidrp) shawnknabel@scorza2:/data/raw_data/KECK_KCWI_SLACS_kinematics_shawn/2021aug13$ reduce_kcwi -f kb*.fits -g -c /local/shawnknabel/kcwi.cfg 2022-02-22 15:04:42:KCWI:INFO: reading proc table file: kcwi.proc 2022-02-22 15:04:42:DRPF:INFO: Framework initialized 2022-02-22 15:04:46:DRPF:INFO: Framework main loop started 2022-02-22 15:04:46:KCWI:INFO: Enabling BOKEH plots 2022-02-22 15:04:46:DRPF:INFO: Event completed: name start_bokeh, action StartBokeh, arg name undef, recurr False 2022-02-22 15:04:46:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00001.fits, recurr False 2022-02-22 15:04:46:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00002.fits, recurr False 2022-02-22 15:04:46:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00003.fits, recurr False 2022-02-22 15:04:46:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00004.fits, recurr False 2022-02-22 15:04:46:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00005.fits, recurr False 2022-02-22 15:04:46:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00006.fits, recurr False 2022-02-22 15:04:46:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00007.fits, recurr False 2022-02-22 15:04:46:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00008.fits, recurr False 2022-02-22 15:04:46:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00009.fits, recurr False 2022-02-22 15:04:46:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00010.fits, recurr False 2022-02-22 15:04:46:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00011.fits, recurr False 2022-02-22 15:04:46:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00012.fits, recurr False 2022-02-22 15:04:46:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00013.fits, recurr False 2022-02-22 15:04:46:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00014.fits, recurr False 2022-02-22 15:04:46:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00015.fits, recurr False 2022-02-22 15:04:46:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00016.fits, recurr False 2022-02-22 15:04:46:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00017.fits, recurr False 2022-02-22 15:04:46:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00018.fits, recurr False 2022-02-22 15:04:46:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00019.fits, recurr False 2022-02-22 15:04:46:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00020.fits, recurr False 2022-02-22 15:04:46:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00021.fits, recurr False 2022-02-22 15:04:46:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00022.fits, recurr False 2022-02-22 15:04:46:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00023.fits, recurr False 2022-02-22 15:04:46:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00024.fits, recurr False 2022-02-22 15:04:46:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00025.fits, recurr False 2022-02-22 15:04:46:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00026.fits, recurr False 2022-02-22 15:04:46:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00027.fits, recurr False 2022-02-22 15:04:46:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00028.fits, recurr False 2022-02-22 15:04:46:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00029.fits, recurr False 2022-02-22 15:04:46:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00030.fits, recurr False 2022-02-22 15:04:46:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00031.fits, recurr False 2022-02-22 15:04:46:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00032.fits, recurr False 2022-02-22 15:04:46:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00033.fits, recurr False 2022-02-22 15:04:46:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00034.fits, recurr False 2022-02-22 15:04:46:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00035.fits, recurr False 2022-02-22 15:04:46:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00036.fits, recurr False 2022-02-22 15:04:46:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00037.fits, recurr False 2022-02-22 15:04:46:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00038.fits, recurr False 2022-02-22 15:04:46:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00039.fits, recurr False 2022-02-22 15:04:46:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00040.fits, recurr False 2022-02-22 15:04:46:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00041.fits, recurr False 2022-02-22 15:04:46:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00042.fits, recurr False 2022-02-22 15:04:46:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00043.fits, recurr False 2022-02-22 15:04:46:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00044.fits, recurr False 2022-02-22 15:04:46:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00045.fits, recurr False 2022-02-22 15:04:46:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00046.fits, recurr False 2022-02-22 15:04:46:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00047.fits, recurr False 2022-02-22 15:04:46:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00048.fits, recurr False 2022-02-22 15:04:46:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00049.fits, recurr False 2022-02-22 15:04:46:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00050.fits, recurr False 2022-02-22 15:04:46:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00051.fits, recurr False 2022-02-22 15:04:46:KCWI:INFO: ------------------- Ingesting file kb210813_00001.fits ------------------- 2022-02-22 15:04:46:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00001.fits 2022-02-22 15:04:46:KCWI:INFO: Looking for MBIAS frames 2022-02-22 15:04:46:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:46:KCWI:INFO: Target type is MBIAS 2022-02-22 15:04:46:KCWI:INFO: Looking for frames with CCDCFG = 2201009 2022-02-22 15:04:46:KCWI:INFO: Looking for CONTBARS frames 2022-02-22 15:04:46:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:46:KCWI:INFO: Target type is CONTBARS 2022-02-22 15:04:46:KCWI:INFO: Looking for frames with STATEID = 611471face9e2454ac394c13 (BL_medium) 2022-02-22 15:04:46:KCWI:INFO: Looking for MFLAT frames 2022-02-22 15:04:46:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:46:KCWI:INFO: Target type is MFLAT 2022-02-22 15:04:46:KCWI:INFO: Looking for frames with STATEID = 611471face9e2454ac394c13 (BL_medium) 2022-02-22 15:04:46:KCWI:INFO: Looking for INVSENS frames 2022-02-22 15:04:46:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:46:KCWI:INFO: Target type is INVSENS 2022-02-22 15:04:46:KCWI:INFO: Looking for frames with STATEID = 611471face9e2454ac394c13 (BL_medium) 2022-02-22 15:04:46:KCWI:INFO: Looking for ARCLAMP frames 2022-02-22 15:04:46:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:46:KCWI:INFO: Target type is ARCLAMP 2022-02-22 15:04:46:KCWI:INFO: Looking for frames with STATEID = 611471face9e2454ac394c13 (BL_medium) 2022-02-22 15:04:46:KCWI:WARNING: UNABLE TO INGEST THE FILE 2022-02-22 15:04:46:KCWI:WARNING: Reason: unable to compute atlas resolution: grating undefined 2022-02-22 15:04:46:DRPF:INFO: Event failed: name next_file, action ingest_file, arg name kb210813_00001.fits, recurr False 2022-02-22 15:04:46:KCWI:WARNING: FILE TYPE is NOT determined. No processing is possible. 2022-02-22 15:04:46:DRPF:INFO: Event completed: name file_ingested, action action_planner, arg name kb210813_00001.fits, recurr False 2022-02-22 15:04:46:KCWI:INFO: ------------------- Ingesting file kb210813_00011.fits ------------------- 2022-02-22 15:04:46:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00011.fits 2022-02-22 15:04:46:KCWI:INFO: Looking for MBIAS frames 2022-02-22 15:04:46:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:46:KCWI:INFO: Target type is MBIAS 2022-02-22 15:04:46:KCWI:INFO: Looking for frames with CCDCFG = 1101009 2022-02-22 15:04:46:KCWI:INFO: Looking for CONTBARS frames 2022-02-22 15:04:46:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:46:KCWI:INFO: Target type is CONTBARS 2022-02-22 15:04:46:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-22 15:04:46:KCWI:INFO: Looking for MFLAT frames 2022-02-22 15:04:46:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:46:KCWI:INFO: Target type is MFLAT 2022-02-22 15:04:46:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-22 15:04:46:KCWI:INFO: Looking for INVSENS frames 2022-02-22 15:04:46:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:46:KCWI:INFO: Target type is INVSENS 2022-02-22 15:04:46:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-22 15:04:46:KCWI:INFO: Looking for ARCLAMP frames 2022-02-22 15:04:46:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:46:KCWI:INFO: Target type is ARCLAMP 2022-02-22 15:04:46:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-22 15:04:46:DRPF:INFO: Event completed: name next_file, action ingest_file, arg name kb210813_00011.fits, recurr False 2022-02-22 15:04:46:KCWI:INFO: FILE TYPE DETERMINED AS BIAS 2022-02-22 15:04:46:KCWI:INFO: GROUPID is 2021-08-13-11 2022-02-22 15:04:46:KCWI:INFO: STATEID is Shared Bias (0) 2022-02-22 15:04:46:KCWI:WARNING: Already processed (already in proctab) 2022-02-22 15:04:46:KCWI:WARNING: Pushing noop to queue 2022-02-22 15:04:46:DRPF:INFO: Event completed: name file_ingested, action action_planner, arg name kb210813_00011.fits, recurr False 2022-02-22 15:04:46:DRPF:INFO: Event completed: name noop, action noop, arg name kb210813_00011.fits, recurr False 2022-02-22 15:04:46:KCWI:INFO: ------------------- Ingesting file kb210813_00012.fits ------------------- 2022-02-22 15:04:46:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00012.fits 2022-02-22 15:04:46:KCWI:INFO: Looking for MBIAS frames 2022-02-22 15:04:46:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:46:KCWI:INFO: Target type is MBIAS 2022-02-22 15:04:46:KCWI:INFO: Looking for frames with CCDCFG = 1101009 2022-02-22 15:04:46:KCWI:INFO: Looking for CONTBARS frames 2022-02-22 15:04:46:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:46:KCWI:INFO: Target type is CONTBARS 2022-02-22 15:04:46:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-22 15:04:46:KCWI:INFO: Looking for MFLAT frames 2022-02-22 15:04:46:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:46:KCWI:INFO: Target type is MFLAT 2022-02-22 15:04:46:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-22 15:04:46:KCWI:INFO: Looking for INVSENS frames 2022-02-22 15:04:46:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:46:KCWI:INFO: Target type is INVSENS 2022-02-22 15:04:46:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-22 15:04:46:KCWI:INFO: Looking for ARCLAMP frames 2022-02-22 15:04:46:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:46:KCWI:INFO: Target type is ARCLAMP 2022-02-22 15:04:46:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-22 15:04:46:DRPF:INFO: Event completed: name next_file, action ingest_file, arg name kb210813_00012.fits, recurr False 2022-02-22 15:04:46:KCWI:INFO: FILE TYPE DETERMINED AS BIAS 2022-02-22 15:04:46:KCWI:INFO: GROUPID is 2021-08-13-11 2022-02-22 15:04:46:KCWI:INFO: STATEID is Shared Bias (0) 2022-02-22 15:04:46:KCWI:WARNING: Already processed (already in proctab) 2022-02-22 15:04:46:KCWI:WARNING: Pushing noop to queue 2022-02-22 15:04:46:DRPF:INFO: Event completed: name file_ingested, action action_planner, arg name kb210813_00012.fits, recurr False 2022-02-22 15:04:46:DRPF:INFO: Event completed: name noop, action noop, arg name kb210813_00012.fits, recurr False 2022-02-22 15:04:46:KCWI:INFO: ------------------- Ingesting file kb210813_00013.fits ------------------- 2022-02-22 15:04:47:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00013.fits 2022-02-22 15:04:47:KCWI:INFO: Looking for MBIAS frames 2022-02-22 15:04:47:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:47:KCWI:INFO: Target type is MBIAS 2022-02-22 15:04:47:KCWI:INFO: Looking for frames with CCDCFG = 1101009 2022-02-22 15:04:47:KCWI:INFO: Looking for CONTBARS frames 2022-02-22 15:04:47:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:47:KCWI:INFO: Target type is CONTBARS 2022-02-22 15:04:47:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-22 15:04:47:KCWI:INFO: Looking for MFLAT frames 2022-02-22 15:04:47:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:47:KCWI:INFO: Target type is MFLAT 2022-02-22 15:04:47:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-22 15:04:47:KCWI:INFO: Looking for INVSENS frames 2022-02-22 15:04:47:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:47:KCWI:INFO: Target type is INVSENS 2022-02-22 15:04:47:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-22 15:04:47:KCWI:INFO: Looking for ARCLAMP frames 2022-02-22 15:04:47:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:47:KCWI:INFO: Target type is ARCLAMP 2022-02-22 15:04:47:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-22 15:04:47:DRPF:INFO: Event completed: name next_file, action ingest_file, arg name kb210813_00013.fits, recurr False 2022-02-22 15:04:47:KCWI:INFO: FILE TYPE DETERMINED AS BIAS 2022-02-22 15:04:47:KCWI:INFO: GROUPID is 2021-08-13-11 2022-02-22 15:04:47:KCWI:INFO: STATEID is Shared Bias (0) 2022-02-22 15:04:47:KCWI:WARNING: Already processed (already in proctab) 2022-02-22 15:04:47:KCWI:WARNING: Pushing noop to queue 2022-02-22 15:04:47:DRPF:INFO: Event completed: name file_ingested, action action_planner, arg name kb210813_00013.fits, recurr False 2022-02-22 15:04:47:DRPF:INFO: Event completed: name noop, action noop, arg name kb210813_00013.fits, recurr False 2022-02-22 15:04:47:KCWI:INFO: ------------------- Ingesting file kb210813_00014.fits ------------------- 2022-02-22 15:04:47:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00014.fits 2022-02-22 15:04:47:KCWI:INFO: Looking for MBIAS frames 2022-02-22 15:04:47:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:47:KCWI:INFO: Target type is MBIAS 2022-02-22 15:04:47:KCWI:INFO: Looking for frames with CCDCFG = 1101009 2022-02-22 15:04:47:KCWI:INFO: Looking for CONTBARS frames 2022-02-22 15:04:47:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:47:KCWI:INFO: Target type is CONTBARS 2022-02-22 15:04:47:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-22 15:04:47:KCWI:INFO: Looking for MFLAT frames 2022-02-22 15:04:47:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:47:KCWI:INFO: Target type is MFLAT 2022-02-22 15:04:47:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-22 15:04:47:KCWI:INFO: Looking for INVSENS frames 2022-02-22 15:04:47:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:47:KCWI:INFO: Target type is INVSENS 2022-02-22 15:04:47:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-22 15:04:47:KCWI:INFO: Looking for ARCLAMP frames 2022-02-22 15:04:47:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:47:KCWI:INFO: Target type is ARCLAMP 2022-02-22 15:04:47:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-22 15:04:47:DRPF:INFO: Event completed: name next_file, action ingest_file, arg name kb210813_00014.fits, recurr False 2022-02-22 15:04:47:KCWI:INFO: FILE TYPE DETERMINED AS BIAS 2022-02-22 15:04:47:KCWI:INFO: GROUPID is 2021-08-13-11 2022-02-22 15:04:47:KCWI:INFO: STATEID is Shared Bias (0) 2022-02-22 15:04:47:KCWI:WARNING: Already processed (already in proctab) 2022-02-22 15:04:47:KCWI:WARNING: Pushing noop to queue 2022-02-22 15:04:47:DRPF:INFO: Event completed: name file_ingested, action action_planner, arg name kb210813_00014.fits, recurr False 2022-02-22 15:04:47:DRPF:INFO: Event completed: name noop, action noop, arg name kb210813_00014.fits, recurr False 2022-02-22 15:04:47:KCWI:INFO: ------------------- Ingesting file kb210813_00015.fits ------------------- 2022-02-22 15:04:47:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00015.fits 2022-02-22 15:04:47:KCWI:INFO: Looking for MBIAS frames 2022-02-22 15:04:47:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:47:KCWI:INFO: Target type is MBIAS 2022-02-22 15:04:47:KCWI:INFO: Looking for frames with CCDCFG = 1101009 2022-02-22 15:04:47:KCWI:INFO: Looking for CONTBARS frames 2022-02-22 15:04:47:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:47:KCWI:INFO: Target type is CONTBARS 2022-02-22 15:04:47:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-22 15:04:47:KCWI:INFO: Looking for MFLAT frames 2022-02-22 15:04:47:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:47:KCWI:INFO: Target type is MFLAT 2022-02-22 15:04:47:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-22 15:04:47:KCWI:INFO: Looking for INVSENS frames 2022-02-22 15:04:47:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:47:KCWI:INFO: Target type is INVSENS 2022-02-22 15:04:47:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-22 15:04:47:KCWI:INFO: Looking for ARCLAMP frames 2022-02-22 15:04:47:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:47:KCWI:INFO: Target type is ARCLAMP 2022-02-22 15:04:47:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-22 15:04:47:DRPF:INFO: Event completed: name next_file, action ingest_file, arg name kb210813_00015.fits, recurr False 2022-02-22 15:04:47:KCWI:INFO: FILE TYPE DETERMINED AS BIAS 2022-02-22 15:04:47:KCWI:INFO: GROUPID is 2021-08-13-11 2022-02-22 15:04:47:KCWI:INFO: STATEID is Shared Bias (0) 2022-02-22 15:04:47:KCWI:WARNING: Already processed (already in proctab) 2022-02-22 15:04:47:KCWI:WARNING: Pushing noop to queue 2022-02-22 15:04:47:DRPF:INFO: Event completed: name file_ingested, action action_planner, arg name kb210813_00015.fits, recurr False 2022-02-22 15:04:47:DRPF:INFO: Event completed: name noop, action noop, arg name kb210813_00015.fits, recurr False 2022-02-22 15:04:47:KCWI:INFO: ------------------- Ingesting file kb210813_00016.fits ------------------- 2022-02-22 15:04:47:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00016.fits 2022-02-22 15:04:47:KCWI:INFO: Looking for MBIAS frames 2022-02-22 15:04:47:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:47:KCWI:INFO: Target type is MBIAS 2022-02-22 15:04:47:KCWI:INFO: Looking for frames with CCDCFG = 1101009 2022-02-22 15:04:47:KCWI:INFO: Looking for CONTBARS frames 2022-02-22 15:04:47:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:47:KCWI:INFO: Target type is CONTBARS 2022-02-22 15:04:47:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-22 15:04:47:KCWI:INFO: Looking for MFLAT frames 2022-02-22 15:04:47:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:47:KCWI:INFO: Target type is MFLAT 2022-02-22 15:04:47:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-22 15:04:47:KCWI:INFO: Looking for INVSENS frames 2022-02-22 15:04:47:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:47:KCWI:INFO: Target type is INVSENS 2022-02-22 15:04:47:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-22 15:04:47:KCWI:INFO: Looking for ARCLAMP frames 2022-02-22 15:04:47:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:47:KCWI:INFO: Target type is ARCLAMP 2022-02-22 15:04:47:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-22 15:04:47:DRPF:INFO: Event completed: name next_file, action ingest_file, arg name kb210813_00016.fits, recurr False 2022-02-22 15:04:47:KCWI:INFO: FILE TYPE DETERMINED AS BIAS 2022-02-22 15:04:47:KCWI:INFO: GROUPID is 2021-08-13-11 2022-02-22 15:04:47:KCWI:INFO: STATEID is Shared Bias (0) 2022-02-22 15:04:47:KCWI:WARNING: Already processed (already in proctab) 2022-02-22 15:04:47:KCWI:WARNING: Pushing noop to queue 2022-02-22 15:04:47:DRPF:INFO: Event completed: name file_ingested, action action_planner, arg name kb210813_00016.fits, recurr False 2022-02-22 15:04:47:DRPF:INFO: Event completed: name noop, action noop, arg name kb210813_00016.fits, recurr False 2022-02-22 15:04:47:KCWI:INFO: ------------------- Ingesting file kb210813_00017.fits ------------------- 2022-02-22 15:04:47:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00017.fits 2022-02-22 15:04:47:KCWI:INFO: Looking for MBIAS frames 2022-02-22 15:04:47:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:47:KCWI:INFO: Target type is MBIAS 2022-02-22 15:04:47:KCWI:INFO: Looking for frames with CCDCFG = 1101009 2022-02-22 15:04:47:KCWI:INFO: Looking for CONTBARS frames 2022-02-22 15:04:47:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:47:KCWI:INFO: Target type is CONTBARS 2022-02-22 15:04:47:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-22 15:04:47:KCWI:INFO: Looking for MFLAT frames 2022-02-22 15:04:47:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:47:KCWI:INFO: Target type is MFLAT 2022-02-22 15:04:47:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-22 15:04:47:KCWI:INFO: Looking for INVSENS frames 2022-02-22 15:04:47:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:47:KCWI:INFO: Target type is INVSENS 2022-02-22 15:04:47:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-22 15:04:47:KCWI:INFO: Looking for ARCLAMP frames 2022-02-22 15:04:47:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:47:KCWI:INFO: Target type is ARCLAMP 2022-02-22 15:04:47:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-22 15:04:47:DRPF:INFO: Event completed: name next_file, action ingest_file, arg name kb210813_00017.fits, recurr False 2022-02-22 15:04:47:KCWI:INFO: FILE TYPE DETERMINED AS BIAS 2022-02-22 15:04:47:KCWI:INFO: GROUPID is 2021-08-13-11 2022-02-22 15:04:47:KCWI:INFO: STATEID is Shared Bias (0) 2022-02-22 15:04:47:KCWI:WARNING: Already processed (already in proctab) 2022-02-22 15:04:47:KCWI:WARNING: Pushing noop to queue 2022-02-22 15:04:47:DRPF:INFO: Event completed: name file_ingested, action action_planner, arg name kb210813_00017.fits, recurr False 2022-02-22 15:04:47:DRPF:INFO: Event completed: name noop, action noop, arg name kb210813_00017.fits, recurr False 2022-02-22 15:04:47:KCWI:INFO: ------------------- Ingesting file kb210813_00018.fits ------------------- 2022-02-22 15:04:47:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00018.fits 2022-02-22 15:04:47:KCWI:INFO: Looking for MBIAS frames 2022-02-22 15:04:47:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:47:KCWI:INFO: Target type is MBIAS 2022-02-22 15:04:47:KCWI:INFO: Looking for frames with CCDCFG = 1111000 2022-02-22 15:04:47:KCWI:INFO: Looking for CONTBARS frames 2022-02-22 15:04:47:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:47:KCWI:INFO: Target type is CONTBARS 2022-02-22 15:04:47:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 15:04:47:KCWI:INFO: Looking for MFLAT frames 2022-02-22 15:04:47:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:47:KCWI:INFO: Target type is MFLAT 2022-02-22 15:04:47:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 15:04:47:KCWI:INFO: Looking for INVSENS frames 2022-02-22 15:04:47:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:47:KCWI:INFO: Target type is INVSENS 2022-02-22 15:04:47:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 15:04:47:KCWI:INFO: Looking for ARCLAMP frames 2022-02-22 15:04:47:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:47:KCWI:INFO: Target type is ARCLAMP 2022-02-22 15:04:47:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 15:04:47:DRPF:INFO: Event completed: name next_file, action ingest_file, arg name kb210813_00018.fits, recurr False 2022-02-22 15:04:47:KCWI:INFO: FILE TYPE DETERMINED AS CONTBARS 2022-02-22 15:04:47:KCWI:INFO: GROUPID is 2021-08-13-18 2022-02-22 15:04:47:KCWI:INFO: **** STATEID is BL_small_4600 (6115c23cce9e240a4bee8190) 2022-02-22 15:04:47:DRPF:INFO: Event completed: name file_ingested, action action_planner, arg name kb210813_00018.fits, recurr False 2022-02-22 15:04:47:DRPF:INFO: Event completed: name process_contbars, action ProcessContbars, arg name kb210813_00018.fits, recurr False 2022-02-22 15:04:47:KCWI:INFO: Amp1 Read noise from oscan in e-: 3.687 2022-02-22 15:04:48:KCWI:INFO: Amp2 Read noise from oscan in e-: 3.901 2022-02-22 15:04:49:KCWI:INFO: Amp3 Read noise from oscan in e-: 3.714 2022-02-22 15:04:50:KCWI:INFO: Amp4 Read noise from oscan in e-: 3.580 2022-02-22 15:04:52:KCWI:INFO: kcwidrp.primitives.SubtractOverscan 2022-02-22 15:04:52:DRPF:INFO: Event completed: name contbar_subtract_overscan, action SubtractOverscan, arg name kb210813_00018.fits, recurr False 2022-02-22 15:04:52:KCWI:INFO: kcwidrp.primitives.TrimOverscan 2022-02-22 15:04:52:DRPF:INFO: Event completed: name contbar_trim_overscan, action TrimOverscan, arg name kb210813_00018.fits, recurr False 2022-02-22 15:04:52:KCWI:INFO: Applying gain correction of 0.173 in section [1:2048,1:2056] 2022-02-22 15:04:52:KCWI:INFO: Applying gain correction of 0.181 in section [2049:4096,1:2056] 2022-02-22 15:04:52:KCWI:INFO: Applying gain correction of 0.176 in section [1:2048,2057:4112] 2022-02-22 15:04:52:KCWI:INFO: Applying gain correction of 0.177 in section [2049:4096,2057:4112] 2022-02-22 15:04:52:KCWI:INFO: kcwidrp.primitives.CorrectGain 2022-02-22 15:04:52:DRPF:INFO: Event completed: name contbar_correct_gain, action CorrectGain, arg name kb210813_00018.fits, recurr False 2022-02-22 15:04:52:KCWI:INFO: kcwidrp.primitives.RectifyImage 2022-02-22 15:04:52:DRPF:ERROR: Exception [Errno 2] No such file or directory: 'git': 'git' while invoking RectifyImage Traceback (most recent call last): File "/local/shawnknabel/anaconda3/envs/kcwidrp/lib/python3.7/site-packages/keckdrpframework/core/framework.py", line 229, in execute action_output = pipeline.get_action(action_name)(action, context) File "/local/shawnknabel/anaconda3/envs/kcwidrp/lib/python3.7/site-packages/keckdrpframework/pipelines/base_pipeline.py", line 84, in f return obj.apply() File "/local/shawnknabel/anaconda3/envs/kcwidrp/lib/python3.7/site-packages/keckdrpframework/primitives/base_primitive.py", line 57, in apply self.output = self._perform() File "/local/shawnknabel/anaconda3/envs/kcwidrp/lib/python3.7/site-packages/kcwidrp/primitives/RectifyImage.py", line 89, in _perform suffix="int") File "/local/shawnknabel/anaconda3/envs/kcwidrp/lib/python3.7/site-packages/kcwidrp/primitives/kcwi_file_primitives.py", line 717, in kcwi_fits_writer "--tags", "--long"], capture_output=True) File "/local/shawnknabel/anaconda3/envs/kcwidrp/lib/python3.7/subprocess.py", line 488, in run with Popen(popenargs, kwargs) as process: File "/local/shawnknabel/anaconda3/envs/kcwidrp/lib/python3.7/subprocess.py", line 800, in init restore_signals, start_new_session) File "/local/shawnknabel/anaconda3/envs/kcwidrp/lib/python3.7/subprocess.py", line 1551, in _execute_child raise child_exception_type(errno_num, err_msg, err_filename) FileNotFoundError: [Errno 2] No such file or directory: 'git': 'git' 2022-02-22 15:04:52:DRPF:INFO: Event failed: name contbar_rectify_image, action RectifyImage, arg name kb210813_00018.fits, recurr False 2022-02-22 15:04:52:KCWI:INFO: ------------------- Ingesting file kb210813_00019.fits ------------------- 2022-02-22 15:04:52:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00019.fits 2022-02-22 15:04:52:KCWI:INFO: Looking for MBIAS frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is MBIAS 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with CCDCFG = 1111000 2022-02-22 15:04:52:KCWI:INFO: Looking for CONTBARS frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is CONTBARS 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 15:04:52:KCWI:INFO: Looking for MFLAT frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is MFLAT 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 15:04:52:KCWI:INFO: Looking for INVSENS frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is INVSENS 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 15:04:52:KCWI:INFO: Looking for ARCLAMP frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is ARCLAMP 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 15:04:52:KCWI:WARNING: Cannot reduce ARCLAMP frame. Missing continuum bars. Rescheduling for later. 2022-02-22 15:04:52:DRPF:INFO: Event failed: name next_file, action ingest_file, arg name kb210813_00019.fits, recurr True 2022-02-22 15:04:52:KCWI:INFO: ------------------- Ingesting file kb210813_00020.fits ------------------- 2022-02-22 15:04:52:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00020.fits 2022-02-22 15:04:52:KCWI:INFO: Looking for MBIAS frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is MBIAS 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with CCDCFG = 1111000 2022-02-22 15:04:52:KCWI:INFO: Looking for CONTBARS frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is CONTBARS 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 15:04:52:KCWI:INFO: Looking for MFLAT frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is MFLAT 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 15:04:52:KCWI:INFO: Looking for INVSENS frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is INVSENS 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 15:04:52:KCWI:INFO: Looking for ARCLAMP frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is ARCLAMP 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 15:04:52:KCWI:WARNING: Cannot reduce ARCLAMP frame. Missing continuum bars. Rescheduling for later. 2022-02-22 15:04:52:DRPF:INFO: Event failed: name next_file, action ingest_file, arg name kb210813_00020.fits, recurr True 2022-02-22 15:04:52:KCWI:INFO: ------------------- Ingesting file kb210813_00021.fits ------------------- 2022-02-22 15:04:52:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00021.fits 2022-02-22 15:04:52:KCWI:INFO: Looking for MBIAS frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is MBIAS 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with CCDCFG = 1101009 2022-02-22 15:04:52:KCWI:INFO: Looking for CONTBARS frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is CONTBARS 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 15:04:52:KCWI:INFO: Looking for MFLAT frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is MFLAT 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 15:04:52:KCWI:INFO: Looking for INVSENS frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is INVSENS 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 15:04:52:KCWI:INFO: Looking for ARCLAMP frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is ARCLAMP 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 15:04:52:KCWI:WARNING: Cannot reduce FLATLAMP frame. Missing master bias. Rescheduling for later. 2022-02-22 15:04:52:DRPF:INFO: Event failed: name next_file, action ingest_file, arg name kb210813_00021.fits, recurr True 2022-02-22 15:04:52:KCWI:INFO: ------------------- Ingesting file kb210813_00022.fits ------------------- 2022-02-22 15:04:52:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00022.fits 2022-02-22 15:04:52:KCWI:INFO: Looking for MBIAS frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is MBIAS 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with CCDCFG = 1101009 2022-02-22 15:04:52:KCWI:INFO: Looking for CONTBARS frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is CONTBARS 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 15:04:52:KCWI:INFO: Looking for MFLAT frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is MFLAT 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 15:04:52:KCWI:INFO: Looking for INVSENS frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is INVSENS 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 15:04:52:KCWI:INFO: Looking for ARCLAMP frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is ARCLAMP 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 15:04:52:KCWI:WARNING: Cannot reduce FLATLAMP frame. Missing master bias. Rescheduling for later. 2022-02-22 15:04:52:DRPF:INFO: Event failed: name next_file, action ingest_file, arg name kb210813_00022.fits, recurr True 2022-02-22 15:04:52:KCWI:INFO: ------------------- Ingesting file kb210813_00023.fits ------------------- 2022-02-22 15:04:52:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00023.fits 2022-02-22 15:04:52:KCWI:INFO: Looking for MBIAS frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is MBIAS 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with CCDCFG = 1101009 2022-02-22 15:04:52:KCWI:INFO: Looking for CONTBARS frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is CONTBARS 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 15:04:52:KCWI:INFO: Looking for MFLAT frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is MFLAT 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 15:04:52:KCWI:INFO: Looking for INVSENS frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is INVSENS 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 15:04:52:KCWI:INFO: Looking for ARCLAMP frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is ARCLAMP 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 15:04:52:KCWI:WARNING: Cannot reduce FLATLAMP frame. Missing master bias. Rescheduling for later. 2022-02-22 15:04:52:DRPF:INFO: Event failed: name next_file, action ingest_file, arg name kb210813_00023.fits, recurr True 2022-02-22 15:04:52:KCWI:INFO: ------------------- Ingesting file kb210813_00024.fits ------------------- 2022-02-22 15:04:52:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00024.fits 2022-02-22 15:04:52:KCWI:INFO: Looking for MBIAS frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is MBIAS 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with CCDCFG = 1101009 2022-02-22 15:04:52:KCWI:INFO: Looking for CONTBARS frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is CONTBARS 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 15:04:52:KCWI:INFO: Looking for MFLAT frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is MFLAT 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 15:04:52:KCWI:INFO: Looking for INVSENS frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is INVSENS 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 15:04:52:KCWI:INFO: Looking for ARCLAMP frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is ARCLAMP 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 15:04:52:KCWI:WARNING: Cannot reduce FLATLAMP frame. Missing master bias. Rescheduling for later. 2022-02-22 15:04:52:DRPF:INFO: Event failed: name next_file, action ingest_file, arg name kb210813_00024.fits, recurr True 2022-02-22 15:04:52:KCWI:INFO: ------------------- Ingesting file kb210813_00025.fits ------------------- 2022-02-22 15:04:52:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00025.fits 2022-02-22 15:04:52:KCWI:INFO: Looking for MBIAS frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is MBIAS 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with CCDCFG = 1101009 2022-02-22 15:04:52:KCWI:INFO: Looking for CONTBARS frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is CONTBARS 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 15:04:52:KCWI:INFO: Looking for MFLAT frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is MFLAT 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 15:04:52:KCWI:INFO: Looking for INVSENS frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is INVSENS 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 15:04:52:KCWI:INFO: Looking for ARCLAMP frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is ARCLAMP 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 15:04:52:KCWI:WARNING: Cannot reduce FLATLAMP frame. Missing master bias. Rescheduling for later. 2022-02-22 15:04:52:DRPF:INFO: Event failed: name next_file, action ingest_file, arg name kb210813_00025.fits, recurr True 2022-02-22 15:04:52:KCWI:INFO: ------------------- Ingesting file kb210813_00026.fits ------------------- 2022-02-22 15:04:52:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00026.fits 2022-02-22 15:04:52:KCWI:INFO: Looking for MBIAS frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is MBIAS 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with CCDCFG = 1101009 2022-02-22 15:04:52:KCWI:INFO: Looking for CONTBARS frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is CONTBARS 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 15:04:52:KCWI:INFO: Looking for MFLAT frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is MFLAT 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 15:04:52:KCWI:INFO: Looking for INVSENS frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is INVSENS 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 15:04:52:KCWI:INFO: Looking for ARCLAMP frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is ARCLAMP 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 15:04:52:KCWI:WARNING: Cannot reduce FLATLAMP frame. Missing master bias. Rescheduling for later. 2022-02-22 15:04:52:DRPF:INFO: Event failed: name next_file, action ingest_file, arg name kb210813_00026.fits, recurr True 2022-02-22 15:04:52:KCWI:INFO: ------------------- Ingesting file kb210813_00027.fits ------------------- 2022-02-22 15:04:52:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00027.fits 2022-02-22 15:04:52:KCWI:INFO: Looking for MBIAS frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is MBIAS 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with CCDCFG = 1101009 2022-02-22 15:04:52:KCWI:INFO: Looking for CONTBARS frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is CONTBARS 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 15:04:52:KCWI:INFO: Looking for MFLAT frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is MFLAT 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 15:04:52:KCWI:INFO: Looking for INVSENS frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is INVSENS 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 15:04:52:KCWI:INFO: Looking for ARCLAMP frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is ARCLAMP 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 15:04:52:KCWI:WARNING: Cannot reduce DOMEFLAT frame. Missing master bias. Rescheduling for later. 2022-02-22 15:04:52:DRPF:INFO: Event failed: name next_file, action ingest_file, arg name kb210813_00027.fits, recurr True 2022-02-22 15:04:52:KCWI:INFO: ------------------- Ingesting file kb210813_00028.fits ------------------- 2022-02-22 15:04:52:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00028.fits 2022-02-22 15:04:52:KCWI:INFO: Looking for MBIAS frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is MBIAS 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with CCDCFG = 1101009 2022-02-22 15:04:52:KCWI:INFO: Looking for CONTBARS frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is CONTBARS 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 15:04:52:KCWI:INFO: Looking for MFLAT frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is MFLAT 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 15:04:52:KCWI:INFO: Looking for INVSENS frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is INVSENS 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 15:04:52:KCWI:INFO: Looking for ARCLAMP frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is ARCLAMP 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 15:04:52:KCWI:WARNING: Cannot reduce DOMEFLAT frame. Missing master bias. Rescheduling for later. 2022-02-22 15:04:52:DRPF:INFO: Event failed: name next_file, action ingest_file, arg name kb210813_00028.fits, recurr True 2022-02-22 15:04:52:KCWI:INFO: ------------------- Ingesting file kb210813_00029.fits ------------------- 2022-02-22 15:04:52:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00029.fits 2022-02-22 15:04:52:KCWI:INFO: Looking for MBIAS frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is MBIAS 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with CCDCFG = 1101009 2022-02-22 15:04:52:KCWI:INFO: Looking for CONTBARS frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is CONTBARS 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 15:04:52:KCWI:INFO: Looking for MFLAT frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is MFLAT 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 15:04:52:KCWI:INFO: Looking for INVSENS frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is INVSENS 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 15:04:52:KCWI:INFO: Looking for ARCLAMP frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is ARCLAMP 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 15:04:52:KCWI:WARNING: Cannot reduce DOMEFLAT frame. Missing master bias. Rescheduling for later. 2022-02-22 15:04:52:DRPF:INFO: Event failed: name next_file, action ingest_file, arg name kb210813_00029.fits, recurr True 2022-02-22 15:04:52:KCWI:INFO: ------------------- Ingesting file kb210813_00048.fits ------------------- 2022-02-22 15:04:52:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00048.fits 2022-02-22 15:04:52:KCWI:INFO: Looking for MBIAS frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is MBIAS 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with CCDCFG = 1101009 2022-02-22 15:04:52:KCWI:INFO: Looking for CONTBARS frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is CONTBARS 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 15:04:52:KCWI:INFO: Looking for MFLAT frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is MFLAT 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 15:04:52:KCWI:INFO: Looking for INVSENS frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is INVSENS 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 15:04:52:KCWI:INFO: Looking for ARCLAMP frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is ARCLAMP 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 15:04:52:KCWI:WARNING: Cannot reduce TWIFLAT frame. Missing master bias. Rescheduling for later. 2022-02-22 15:04:52:DRPF:INFO: Event failed: name next_file, action ingest_file, arg name kb210813_00048.fits, recurr True 2022-02-22 15:04:52:KCWI:INFO: ------------------- Ingesting file kb210813_00031.fits ------------------- 2022-02-22 15:04:52:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00031.fits 2022-02-22 15:04:52:KCWI:INFO: Looking for MBIAS frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is MBIAS 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with CCDCFG = 1101009 2022-02-22 15:04:52:KCWI:INFO: Looking for CONTBARS frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is CONTBARS 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 15:04:52:KCWI:INFO: Looking for MFLAT frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is MFLAT 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 15:04:52:KCWI:INFO: Looking for INVSENS frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is INVSENS 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 15:04:52:KCWI:INFO: Looking for ARCLAMP frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is ARCLAMP 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 15:04:52:KCWI:WARNING: Cannot reduce OBJECT frame. Rescheduling for later. Found: 2022-02-22 15:04:52:KCWI:WARNING: MBIAS: 0 2022-02-22 15:04:52:KCWI:WARNING: MFLAT: 0 2022-02-22 15:04:52:KCWI:WARNING: ARCLAMP: 0 2022-02-22 15:04:52:DRPF:INFO: Event failed: name next_file, action ingest_file, arg name kb210813_00031.fits, recurr True 2022-02-22 15:04:52:KCWI:INFO: ------------------- Ingesting file kb210813_00032.fits ------------------- 2022-02-22 15:04:52:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00032.fits 2022-02-22 15:04:52:KCWI:INFO: Looking for MBIAS frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is MBIAS 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with CCDCFG = 1101009 2022-02-22 15:04:52:KCWI:INFO: Looking for CONTBARS frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is CONTBARS 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 15:04:52:KCWI:INFO: Looking for MFLAT frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is MFLAT 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 15:04:52:KCWI:INFO: Looking for INVSENS frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is INVSENS 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 15:04:52:KCWI:INFO: Looking for ARCLAMP frames 2022-02-22 15:04:52:KCWI:INFO: Camera is BLUE 2022-02-22 15:04:52:KCWI:INFO: Target type is ARCLAMP 2022-02-22 15:04:52:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 15:04:52:KCWI:WARNING: Cannot reduce OBJECT frame. Rescheduling for later. Found: 2022-02-22 15:04:52:KCWI:WARNING: MBIAS: 0 2022-02-22 15:04:52:KCWI:WARNING: MFLAT: 0 2022-02-22 15:04:52:KCWI:WARNING: ARCLAMP: 0 2022-02-22 15:04:52:DRPF:INFO: Event failed: name next_file, action ingest_file, arg name kb210813_00032.fits, recurr True 2022-02-22 15:04:52:KCWI:INFO: ------------------- Ingesting file kb210813_00043.fits -------------------

etc...

MNBrod commented 2 years ago

Can you try deleting the kcwi.proc file and re-running it? That will clear the pipeline's memory of what has/hasn't been touched, and should prompt it to make new masters.

shawnknabel commented 2 years ago

I did that, and it completed some new things before falling into the same loop of errors ingesting the files.

2022-02-22 16:28:24:KCWI:INFO: proc table file not found: kcwi.proc 2022-02-22 16:28:24:DRPF:INFO: Framework initialized 2022-02-22 16:28:28:DRPF:INFO: Framework main loop started 2022-02-22 16:28:28:KCWI:INFO: Enabling BOKEH plots 2022-02-22 16:28:28:DRPF:INFO: Event completed: name start_bokeh, action StartBokeh, arg name undef, recurr False 2022-02-22 16:28:28:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00001.fits, recurr False 2022-02-22 16:28:28:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00002.fits, recurr False 2022-02-22 16:28:28:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00003.fits, recurr False 2022-02-22 16:28:28:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00004.fits, recurr False 2022-02-22 16:28:28:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00005.fits, recurr False 2022-02-22 16:28:28:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00006.fits, recurr False 2022-02-22 16:28:28:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00007.fits, recurr False 2022-02-22 16:28:28:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00008.fits, recurr False 2022-02-22 16:28:28:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00009.fits, recurr False 2022-02-22 16:28:28:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00010.fits, recurr False 2022-02-22 16:28:28:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00011.fits, recurr False 2022-02-22 16:28:28:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00012.fits, recurr False 2022-02-22 16:28:28:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00013.fits, recurr False 2022-02-22 16:28:28:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00014.fits, recurr False 2022-02-22 16:28:28:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00015.fits, recurr False 2022-02-22 16:28:28:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00016.fits, recurr False 2022-02-22 16:28:28:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00017.fits, recurr False 2022-02-22 16:28:28:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00018.fits, recurr False 2022-02-22 16:28:28:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00019.fits, recurr False 2022-02-22 16:28:28:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00020.fits, recurr False 2022-02-22 16:28:28:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00021.fits, recurr False 2022-02-22 16:28:28:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00022.fits, recurr False 2022-02-22 16:28:28:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00023.fits, recurr False 2022-02-22 16:28:28:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00024.fits, recurr False 2022-02-22 16:28:28:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00025.fits, recurr False 2022-02-22 16:28:28:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00026.fits, recurr False 2022-02-22 16:28:28:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00027.fits, recurr False 2022-02-22 16:28:28:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00028.fits, recurr False 2022-02-22 16:28:28:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00029.fits, recurr False 2022-02-22 16:28:28:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00030.fits, recurr False 2022-02-22 16:28:28:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00031.fits, recurr False 2022-02-22 16:28:28:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00032.fits, recurr False 2022-02-22 16:28:28:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00033.fits, recurr False 2022-02-22 16:28:28:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00034.fits, recurr False 2022-02-22 16:28:28:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00035.fits, recurr False 2022-02-22 16:28:28:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00036.fits, recurr False 2022-02-22 16:28:28:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00037.fits, recurr False 2022-02-22 16:28:28:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00038.fits, recurr False 2022-02-22 16:28:28:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00039.fits, recurr False 2022-02-22 16:28:28:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00040.fits, recurr False 2022-02-22 16:28:28:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00041.fits, recurr False 2022-02-22 16:28:28:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00042.fits, recurr False 2022-02-22 16:28:28:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00043.fits, recurr False 2022-02-22 16:28:28:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00044.fits, recurr False 2022-02-22 16:28:28:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00045.fits, recurr False 2022-02-22 16:28:28:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00046.fits, recurr False 2022-02-22 16:28:28:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00047.fits, recurr False 2022-02-22 16:28:28:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00048.fits, recurr False 2022-02-22 16:28:28:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00049.fits, recurr False 2022-02-22 16:28:28:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00050.fits, recurr False 2022-02-22 16:28:28:DRPF:INFO: Event completed: name add_only, action add_to_dataframe_only, arg name kb210813_00051.fits, recurr False 2022-02-22 16:28:28:KCWI:INFO: ------------------- Ingesting file kb210813_00001.fits ------------------- 2022-02-22 16:28:28:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00001.fits 2022-02-22 16:28:28:KCWI:INFO: Looking for MBIAS frames 2022-02-22 16:28:28:KCWI:INFO: Camera is BLUE 2022-02-22 16:28:28:KCWI:INFO: Target type is MBIAS 2022-02-22 16:28:28:KCWI:INFO: Looking for frames with CCDCFG = 2201009 2022-02-22 16:28:28:KCWI:INFO: Looking for CONTBARS frames 2022-02-22 16:28:28:KCWI:INFO: Camera is BLUE 2022-02-22 16:28:28:KCWI:INFO: Target type is CONTBARS 2022-02-22 16:28:28:KCWI:INFO: Looking for frames with STATEID = 611471face9e2454ac394c13 (BL_medium) 2022-02-22 16:28:28:KCWI:INFO: Looking for MFLAT frames 2022-02-22 16:28:28:KCWI:INFO: Camera is BLUE 2022-02-22 16:28:28:KCWI:INFO: Target type is MFLAT 2022-02-22 16:28:28:KCWI:INFO: Looking for frames with STATEID = 611471face9e2454ac394c13 (BL_medium) 2022-02-22 16:28:28:KCWI:INFO: Looking for INVSENS frames 2022-02-22 16:28:28:KCWI:INFO: Camera is BLUE 2022-02-22 16:28:28:KCWI:INFO: Target type is INVSENS 2022-02-22 16:28:28:KCWI:INFO: Looking for frames with STATEID = 611471face9e2454ac394c13 (BL_medium) 2022-02-22 16:28:28:KCWI:INFO: Looking for ARCLAMP frames 2022-02-22 16:28:28:KCWI:INFO: Camera is BLUE 2022-02-22 16:28:28:KCWI:INFO: Target type is ARCLAMP 2022-02-22 16:28:28:KCWI:INFO: Looking for frames with STATEID = 611471face9e2454ac394c13 (BL_medium) 2022-02-22 16:28:28:KCWI:WARNING: UNABLE TO INGEST THE FILE 2022-02-22 16:28:28:KCWI:WARNING: Reason: unable to compute atlas resolution: grating undefined 2022-02-22 16:28:28:DRPF:INFO: Event failed: name next_file, action ingest_file, arg name kb210813_00001.fits, recurr False 2022-02-22 16:28:28:KCWI:WARNING: FILE TYPE is NOT determined. No processing is possible. 2022-02-22 16:28:28:DRPF:INFO: Event completed: name file_ingested, action action_planner, arg name kb210813_00001.fits, recurr False 2022-02-22 16:28:28:KCWI:INFO: ------------------- Ingesting file kb210813_00011.fits ------------------- 2022-02-22 16:28:28:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00011.fits 2022-02-22 16:28:28:KCWI:INFO: Looking for MBIAS frames 2022-02-22 16:28:28:KCWI:INFO: Camera is BLUE 2022-02-22 16:28:28:KCWI:INFO: Target type is MBIAS 2022-02-22 16:28:28:KCWI:INFO: Looking for frames with CCDCFG = 1101009 2022-02-22 16:28:28:KCWI:INFO: Looking for CONTBARS frames 2022-02-22 16:28:28:KCWI:INFO: Camera is BLUE 2022-02-22 16:28:28:KCWI:INFO: Target type is CONTBARS 2022-02-22 16:28:28:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-22 16:28:28:KCWI:INFO: Looking for MFLAT frames 2022-02-22 16:28:28:KCWI:INFO: Camera is BLUE 2022-02-22 16:28:28:KCWI:INFO: Target type is MFLAT 2022-02-22 16:28:28:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-22 16:28:28:KCWI:INFO: Looking for INVSENS frames 2022-02-22 16:28:28:KCWI:INFO: Camera is BLUE 2022-02-22 16:28:28:KCWI:INFO: Target type is INVSENS 2022-02-22 16:28:28:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-22 16:28:28:KCWI:INFO: Looking for ARCLAMP frames 2022-02-22 16:28:28:KCWI:INFO: Camera is BLUE 2022-02-22 16:28:28:KCWI:INFO: Target type is ARCLAMP 2022-02-22 16:28:28:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-22 16:28:28:DRPF:INFO: Event completed: name next_file, action ingest_file, arg name kb210813_00011.fits, recurr False 2022-02-22 16:28:28:KCWI:INFO: FILE TYPE DETERMINED AS BIAS 2022-02-22 16:28:28:KCWI:INFO: GROUPID is 2021-08-13-11 2022-02-22 16:28:28:KCWI:INFO: STATEID is Shared Bias (0) 2022-02-22 16:28:28:DRPF:INFO: Event completed: name file_ingested, action action_planner, arg name kb210813_00011.fits, recurr False 2022-02-22 16:28:28:DRPF:INFO: Event completed: name process_bias, action ProcessBias, arg name kb210813_00011.fits, recurr False 2022-02-22 16:28:29:KCWI:INFO: proctable updated with kb210813_00011.fits and kb210813_00011.fits 2022-02-22 16:28:29:KCWI:INFO: writing proc table file: kcwi.proc 2022-02-22 16:28:29:KCWI:INFO: Checking precondition for MakeMasterBias 2022-02-22 16:28:29:KCWI:INFO: Looking for BIAS frames 2022-02-22 16:28:29:KCWI:INFO: Camera is BLUE 2022-02-22 16:28:29:KCWI:INFO: Target type is BIAS 2022-02-22 16:28:29:KCWI:INFO: Looking for frames with CCDCFG = 1101009 2022-02-22 16:28:29:KCWI:INFO: Looking for frames with GRPID = 2021-08-13-11 2022-02-22 16:28:29:KCWI:INFO: pre condition got 1, expecting 7 2022-02-22 16:28:29:DRPF:INFO: Event failed: name bias_make_master, action MakeMasterBias, arg name kb210813_00011.fits, recurr False 2022-02-22 16:28:29:KCWI:INFO: ------------------- Ingesting file kb210813_00012.fits ------------------- 2022-02-22 16:28:29:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00012.fits 2022-02-22 16:28:29:KCWI:INFO: Looking for MBIAS frames 2022-02-22 16:28:29:KCWI:INFO: Camera is BLUE 2022-02-22 16:28:29:KCWI:INFO: Target type is MBIAS 2022-02-22 16:28:29:KCWI:INFO: Looking for frames with CCDCFG = 1101009 2022-02-22 16:28:29:KCWI:INFO: Looking for CONTBARS frames 2022-02-22 16:28:29:KCWI:INFO: Camera is BLUE 2022-02-22 16:28:29:KCWI:INFO: Target type is CONTBARS 2022-02-22 16:28:29:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-22 16:28:29:KCWI:INFO: Looking for MFLAT frames 2022-02-22 16:28:29:KCWI:INFO: Camera is BLUE 2022-02-22 16:28:29:KCWI:INFO: Target type is MFLAT 2022-02-22 16:28:29:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-22 16:28:29:KCWI:INFO: Looking for INVSENS frames 2022-02-22 16:28:29:KCWI:INFO: Camera is BLUE 2022-02-22 16:28:29:KCWI:INFO: Target type is INVSENS 2022-02-22 16:28:29:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-22 16:28:29:KCWI:INFO: Looking for ARCLAMP frames 2022-02-22 16:28:29:KCWI:INFO: Camera is BLUE 2022-02-22 16:28:29:KCWI:INFO: Target type is ARCLAMP 2022-02-22 16:28:29:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-22 16:28:29:DRPF:INFO: Event completed: name next_file, action ingest_file, arg name kb210813_00012.fits, recurr False 2022-02-22 16:28:29:KCWI:INFO: FILE TYPE DETERMINED AS BIAS 2022-02-22 16:28:29:KCWI:INFO: GROUPID is 2021-08-13-11 2022-02-22 16:28:29:KCWI:INFO: STATEID is Shared Bias (0) 2022-02-22 16:28:29:DRPF:INFO: Event completed: name file_ingested, action action_planner, arg name kb210813_00012.fits, recurr False 2022-02-22 16:28:29:DRPF:INFO: Event completed: name process_bias, action ProcessBias, arg name kb210813_00012.fits, recurr False 2022-02-22 16:28:29:KCWI:INFO: proctable updated with kb210813_00012.fits and kb210813_00012.fits 2022-02-22 16:28:29:KCWI:INFO: writing proc table file: kcwi.proc 2022-02-22 16:28:29:KCWI:INFO: Checking precondition for MakeMasterBias 2022-02-22 16:28:29:KCWI:INFO: Looking for BIAS frames 2022-02-22 16:28:29:KCWI:INFO: Camera is BLUE 2022-02-22 16:28:29:KCWI:INFO: Target type is BIAS 2022-02-22 16:28:29:KCWI:INFO: Looking for frames with CCDCFG = 1101009 2022-02-22 16:28:29:KCWI:INFO: Looking for frames with GRPID = 2021-08-13-11 2022-02-22 16:28:29:KCWI:INFO: pre condition got 2, expecting 7 2022-02-22 16:28:29:DRPF:INFO: Event failed: name bias_make_master, action MakeMasterBias, arg name kb210813_00012.fits, recurr False 2022-02-22 16:28:29:KCWI:INFO: ------------------- Ingesting file kb210813_00013.fits ------------------- 2022-02-22 16:28:29:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00013.fits 2022-02-22 16:28:29:KCWI:INFO: Looking for MBIAS frames 2022-02-22 16:28:29:KCWI:INFO: Camera is BLUE 2022-02-22 16:28:29:KCWI:INFO: Target type is MBIAS 2022-02-22 16:28:29:KCWI:INFO: Looking for frames with CCDCFG = 1101009 2022-02-22 16:28:29:KCWI:INFO: Looking for CONTBARS frames 2022-02-22 16:28:29:KCWI:INFO: Camera is BLUE 2022-02-22 16:28:29:KCWI:INFO: Target type is CONTBARS 2022-02-22 16:28:29:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-22 16:28:29:KCWI:INFO: Looking for MFLAT frames 2022-02-22 16:28:29:KCWI:INFO: Camera is BLUE 2022-02-22 16:28:29:KCWI:INFO: Target type is MFLAT 2022-02-22 16:28:29:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-22 16:28:29:KCWI:INFO: Looking for INVSENS frames 2022-02-22 16:28:29:KCWI:INFO: Camera is BLUE 2022-02-22 16:28:29:KCWI:INFO: Target type is INVSENS 2022-02-22 16:28:29:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-22 16:28:29:KCWI:INFO: Looking for ARCLAMP frames 2022-02-22 16:28:29:KCWI:INFO: Camera is BLUE 2022-02-22 16:28:29:KCWI:INFO: Target type is ARCLAMP 2022-02-22 16:28:29:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-22 16:28:29:DRPF:INFO: Event completed: name next_file, action ingest_file, arg name kb210813_00013.fits, recurr False 2022-02-22 16:28:29:KCWI:INFO: FILE TYPE DETERMINED AS BIAS 2022-02-22 16:28:29:KCWI:INFO: GROUPID is 2021-08-13-11 2022-02-22 16:28:29:KCWI:INFO: STATEID is Shared Bias (0) 2022-02-22 16:28:29:DRPF:INFO: Event completed: name file_ingested, action action_planner, arg name kb210813_00013.fits, recurr False 2022-02-22 16:28:29:DRPF:INFO: Event completed: name process_bias, action ProcessBias, arg name kb210813_00013.fits, recurr False 2022-02-22 16:28:29:KCWI:INFO: proctable updated with kb210813_00013.fits and kb210813_00013.fits 2022-02-22 16:28:29:KCWI:INFO: writing proc table file: kcwi.proc 2022-02-22 16:28:29:KCWI:INFO: Checking precondition for MakeMasterBias 2022-02-22 16:28:29:KCWI:INFO: Looking for BIAS frames 2022-02-22 16:28:29:KCWI:INFO: Camera is BLUE 2022-02-22 16:28:29:KCWI:INFO: Target type is BIAS 2022-02-22 16:28:29:KCWI:INFO: Looking for frames with CCDCFG = 1101009 2022-02-22 16:28:29:KCWI:INFO: Looking for frames with GRPID = 2021-08-13-11 2022-02-22 16:28:29:KCWI:INFO: pre condition got 3, expecting 7 2022-02-22 16:28:29:DRPF:INFO: Event failed: name bias_make_master, action MakeMasterBias, arg name kb210813_00013.fits, recurr False 2022-02-22 16:28:29:KCWI:INFO: ------------------- Ingesting file kb210813_00014.fits ------------------- 2022-02-22 16:28:29:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00014.fits 2022-02-22 16:28:29:KCWI:INFO: Looking for MBIAS frames 2022-02-22 16:28:29:KCWI:INFO: Camera is BLUE 2022-02-22 16:28:29:KCWI:INFO: Target type is MBIAS 2022-02-22 16:28:29:KCWI:INFO: Looking for frames with CCDCFG = 1101009 2022-02-22 16:28:29:KCWI:INFO: Looking for CONTBARS frames 2022-02-22 16:28:29:KCWI:INFO: Camera is BLUE 2022-02-22 16:28:29:KCWI:INFO: Target type is CONTBARS 2022-02-22 16:28:29:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-22 16:28:29:KCWI:INFO: Looking for MFLAT frames 2022-02-22 16:28:29:KCWI:INFO: Camera is BLUE 2022-02-22 16:28:29:KCWI:INFO: Target type is MFLAT 2022-02-22 16:28:29:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-22 16:28:29:KCWI:INFO: Looking for INVSENS frames 2022-02-22 16:28:29:KCWI:INFO: Camera is BLUE 2022-02-22 16:28:29:KCWI:INFO: Target type is INVSENS 2022-02-22 16:28:29:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-22 16:28:29:KCWI:INFO: Looking for ARCLAMP frames 2022-02-22 16:28:29:KCWI:INFO: Camera is BLUE 2022-02-22 16:28:29:KCWI:INFO: Target type is ARCLAMP 2022-02-22 16:28:29:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-22 16:28:29:DRPF:INFO: Event completed: name next_file, action ingest_file, arg name kb210813_00014.fits, recurr False 2022-02-22 16:28:29:KCWI:INFO: FILE TYPE DETERMINED AS BIAS 2022-02-22 16:28:29:KCWI:INFO: GROUPID is 2021-08-13-11 2022-02-22 16:28:29:KCWI:INFO: STATEID is Shared Bias (0) 2022-02-22 16:28:29:DRPF:INFO: Event completed: name file_ingested, action action_planner, arg name kb210813_00014.fits, recurr False 2022-02-22 16:28:29:DRPF:INFO: Event completed: name process_bias, action ProcessBias, arg name kb210813_00014.fits, recurr False 2022-02-22 16:28:29:KCWI:INFO: proctable updated with kb210813_00014.fits and kb210813_00014.fits 2022-02-22 16:28:29:KCWI:INFO: writing proc table file: kcwi.proc 2022-02-22 16:28:29:KCWI:INFO: Checking precondition for MakeMasterBias 2022-02-22 16:28:29:KCWI:INFO: Looking for BIAS frames 2022-02-22 16:28:29:KCWI:INFO: Camera is BLUE 2022-02-22 16:28:29:KCWI:INFO: Target type is BIAS 2022-02-22 16:28:29:KCWI:INFO: Looking for frames with CCDCFG = 1101009 2022-02-22 16:28:29:KCWI:INFO: Looking for frames with GRPID = 2021-08-13-11 2022-02-22 16:28:29:KCWI:INFO: pre condition got 4, expecting 7 2022-02-22 16:28:29:DRPF:INFO: Event failed: name bias_make_master, action MakeMasterBias, arg name kb210813_00014.fits, recurr False 2022-02-22 16:28:29:KCWI:INFO: ------------------- Ingesting file kb210813_00015.fits ------------------- 2022-02-22 16:28:29:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00015.fits 2022-02-22 16:28:29:KCWI:INFO: Looking for MBIAS frames 2022-02-22 16:28:29:KCWI:INFO: Camera is BLUE 2022-02-22 16:28:29:KCWI:INFO: Target type is MBIAS 2022-02-22 16:28:29:KCWI:INFO: Looking for frames with CCDCFG = 1101009 2022-02-22 16:28:29:KCWI:INFO: Looking for CONTBARS frames 2022-02-22 16:28:29:KCWI:INFO: Camera is BLUE 2022-02-22 16:28:29:KCWI:INFO: Target type is CONTBARS 2022-02-22 16:28:29:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-22 16:28:29:KCWI:INFO: Looking for MFLAT frames 2022-02-22 16:28:29:KCWI:INFO: Camera is BLUE 2022-02-22 16:28:29:KCWI:INFO: Target type is MFLAT 2022-02-22 16:28:29:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-22 16:28:29:KCWI:INFO: Looking for INVSENS frames 2022-02-22 16:28:29:KCWI:INFO: Camera is BLUE 2022-02-22 16:28:29:KCWI:INFO: Target type is INVSENS 2022-02-22 16:28:29:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-22 16:28:29:KCWI:INFO: Looking for ARCLAMP frames 2022-02-22 16:28:29:KCWI:INFO: Camera is BLUE 2022-02-22 16:28:29:KCWI:INFO: Target type is ARCLAMP 2022-02-22 16:28:29:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-22 16:28:29:DRPF:INFO: Event completed: name next_file, action ingest_file, arg name kb210813_00015.fits, recurr False 2022-02-22 16:28:29:KCWI:INFO: FILE TYPE DETERMINED AS BIAS 2022-02-22 16:28:29:KCWI:INFO: GROUPID is 2021-08-13-11 2022-02-22 16:28:29:KCWI:INFO: STATEID is Shared Bias (0) 2022-02-22 16:28:29:DRPF:INFO: Event completed: name file_ingested, action action_planner, arg name kb210813_00015.fits, recurr False 2022-02-22 16:28:29:DRPF:INFO: Event completed: name process_bias, action ProcessBias, arg name kb210813_00015.fits, recurr False 2022-02-22 16:28:29:KCWI:INFO: proctable updated with kb210813_00015.fits and kb210813_00015.fits 2022-02-22 16:28:29:KCWI:INFO: writing proc table file: kcwi.proc 2022-02-22 16:28:29:KCWI:INFO: Checking precondition for MakeMasterBias 2022-02-22 16:28:29:KCWI:INFO: Looking for BIAS frames 2022-02-22 16:28:29:KCWI:INFO: Camera is BLUE 2022-02-22 16:28:29:KCWI:INFO: Target type is BIAS 2022-02-22 16:28:29:KCWI:INFO: Looking for frames with CCDCFG = 1101009 2022-02-22 16:28:29:KCWI:INFO: Looking for frames with GRPID = 2021-08-13-11 2022-02-22 16:28:29:KCWI:INFO: pre condition got 5, expecting 7 2022-02-22 16:28:29:DRPF:INFO: Event failed: name bias_make_master, action MakeMasterBias, arg name kb210813_00015.fits, recurr False 2022-02-22 16:28:29:KCWI:INFO: ------------------- Ingesting file kb210813_00016.fits ------------------- 2022-02-22 16:28:29:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00016.fits 2022-02-22 16:28:29:KCWI:INFO: Looking for MBIAS frames 2022-02-22 16:28:29:KCWI:INFO: Camera is BLUE 2022-02-22 16:28:29:KCWI:INFO: Target type is MBIAS 2022-02-22 16:28:29:KCWI:INFO: Looking for frames with CCDCFG = 1101009 2022-02-22 16:28:29:KCWI:INFO: Looking for CONTBARS frames 2022-02-22 16:28:29:KCWI:INFO: Camera is BLUE 2022-02-22 16:28:29:KCWI:INFO: Target type is CONTBARS 2022-02-22 16:28:29:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-22 16:28:29:KCWI:INFO: Looking for MFLAT frames 2022-02-22 16:28:29:KCWI:INFO: Camera is BLUE 2022-02-22 16:28:29:KCWI:INFO: Target type is MFLAT 2022-02-22 16:28:29:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-22 16:28:29:KCWI:INFO: Looking for INVSENS frames 2022-02-22 16:28:29:KCWI:INFO: Camera is BLUE 2022-02-22 16:28:29:KCWI:INFO: Target type is INVSENS 2022-02-22 16:28:29:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-22 16:28:29:KCWI:INFO: Looking for ARCLAMP frames 2022-02-22 16:28:29:KCWI:INFO: Camera is BLUE 2022-02-22 16:28:29:KCWI:INFO: Target type is ARCLAMP 2022-02-22 16:28:29:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-22 16:28:29:DRPF:INFO: Event completed: name next_file, action ingest_file, arg name kb210813_00016.fits, recurr False 2022-02-22 16:28:29:KCWI:INFO: FILE TYPE DETERMINED AS BIAS 2022-02-22 16:28:29:KCWI:INFO: GROUPID is 2021-08-13-11 2022-02-22 16:28:29:KCWI:INFO: STATEID is Shared Bias (0) 2022-02-22 16:28:29:DRPF:INFO: Event completed: name file_ingested, action action_planner, arg name kb210813_00016.fits, recurr False 2022-02-22 16:28:29:DRPF:INFO: Event completed: name process_bias, action ProcessBias, arg name kb210813_00016.fits, recurr False 2022-02-22 16:28:29:KCWI:INFO: proctable updated with kb210813_00016.fits and kb210813_00016.fits 2022-02-22 16:28:29:KCWI:INFO: writing proc table file: kcwi.proc 2022-02-22 16:28:29:KCWI:INFO: Checking precondition for MakeMasterBias 2022-02-22 16:28:29:KCWI:INFO: Looking for BIAS frames 2022-02-22 16:28:29:KCWI:INFO: Camera is BLUE 2022-02-22 16:28:29:KCWI:INFO: Target type is BIAS 2022-02-22 16:28:29:KCWI:INFO: Looking for frames with CCDCFG = 1101009 2022-02-22 16:28:29:KCWI:INFO: Looking for frames with GRPID = 2021-08-13-11 2022-02-22 16:28:29:KCWI:INFO: pre condition got 6, expecting 7 2022-02-22 16:28:29:DRPF:INFO: Event failed: name bias_make_master, action MakeMasterBias, arg name kb210813_00016.fits, recurr False 2022-02-22 16:28:29:KCWI:INFO: ------------------- Ingesting file kb210813_00017.fits ------------------- 2022-02-22 16:28:29:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00017.fits 2022-02-22 16:28:29:KCWI:INFO: Looking for MBIAS frames 2022-02-22 16:28:29:KCWI:INFO: Camera is BLUE 2022-02-22 16:28:29:KCWI:INFO: Target type is MBIAS 2022-02-22 16:28:29:KCWI:INFO: Looking for frames with CCDCFG = 1101009 2022-02-22 16:28:29:KCWI:INFO: Looking for CONTBARS frames 2022-02-22 16:28:29:KCWI:INFO: Camera is BLUE 2022-02-22 16:28:29:KCWI:INFO: Target type is CONTBARS 2022-02-22 16:28:29:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-22 16:28:29:KCWI:INFO: Looking for MFLAT frames 2022-02-22 16:28:29:KCWI:INFO: Camera is BLUE 2022-02-22 16:28:29:KCWI:INFO: Target type is MFLAT 2022-02-22 16:28:29:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-22 16:28:29:KCWI:INFO: Looking for INVSENS frames 2022-02-22 16:28:29:KCWI:INFO: Camera is BLUE 2022-02-22 16:28:29:KCWI:INFO: Target type is INVSENS 2022-02-22 16:28:29:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-22 16:28:29:KCWI:INFO: Looking for ARCLAMP frames 2022-02-22 16:28:29:KCWI:INFO: Camera is BLUE 2022-02-22 16:28:29:KCWI:INFO: Target type is ARCLAMP 2022-02-22 16:28:29:KCWI:INFO: Looking for frames with STATEID = 0 (Shared Bias) 2022-02-22 16:28:29:DRPF:INFO: Event completed: name next_file, action ingest_file, arg name kb210813_00017.fits, recurr False 2022-02-22 16:28:29:KCWI:INFO: FILE TYPE DETERMINED AS BIAS 2022-02-22 16:28:29:KCWI:INFO: GROUPID is 2021-08-13-11 2022-02-22 16:28:29:KCWI:INFO: STATEID is Shared Bias (0) 2022-02-22 16:28:29:DRPF:INFO: Event completed: name file_ingested, action action_planner, arg name kb210813_00017.fits, recurr False 2022-02-22 16:28:29:DRPF:INFO: Event completed: name process_bias, action ProcessBias, arg name kb210813_00017.fits, recurr False 2022-02-22 16:28:29:KCWI:INFO: proctable updated with kb210813_00017.fits and kb210813_00017.fits 2022-02-22 16:28:29:KCWI:INFO: writing proc table file: kcwi.proc 2022-02-22 16:28:29:KCWI:INFO: Checking precondition for MakeMasterBias 2022-02-22 16:28:29:KCWI:INFO: Looking for BIAS frames 2022-02-22 16:28:29:KCWI:INFO: Camera is BLUE 2022-02-22 16:28:29:KCWI:INFO: Target type is BIAS 2022-02-22 16:28:29:KCWI:INFO: Looking for frames with CCDCFG = 1101009 2022-02-22 16:28:29:KCWI:INFO: Looking for frames with GRPID = 2021-08-13-11 2022-02-22 16:28:29:KCWI:INFO: pre condition got 7, expecting 7 2022-02-22 16:28:29:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00011.fits 2022-02-22 16:28:29:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00012.fits 2022-02-22 16:28:29:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00013.fits 2022-02-22 16:28:29:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00014.fits 2022-02-22 16:28:29:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00015.fits 2022-02-22 16:28:29:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00016.fits 2022-02-22 16:28:30:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00017.fits 2022-02-22 16:28:41:KCWI:INFO: Amp1 read noise from bias in e-: 3.049 2022-02-22 16:29:05:KCWI:INFO: >>> Saving to plots/bias_00017_amp1_rdnoise.png 2022-02-22 16:29:05:KCWI:INFO: Amp2 read noise from bias in e-: 2.949 2022-02-22 16:29:08:KCWI:INFO: >>> Saving to plots/bias_00017_amp2_rdnoise.png 2022-02-22 16:29:08:KCWI:INFO: kcwidrp.primitives.MakeMasterBias 2022-02-22 16:29:08:DRPF:ERROR: Exception [Errno 2] No such file or directory: 'git': 'git' while invoking MakeMasterBias Traceback (most recent call last): File "/local/shawnknabel/anaconda3/envs/kcwidrp/lib/python3.7/site-packages/keckdrpframework/core/framework.py", line 229, in execute action_output = pipeline.get_action(action_name)(action, context) File "/local/shawnknabel/anaconda3/envs/kcwidrp/lib/python3.7/site-packages/keckdrpframework/pipelines/base_pipeline.py", line 84, in f return obj.apply() File "/local/shawnknabel/anaconda3/envs/kcwidrp/lib/python3.7/site-packages/keckdrpframework/primitives/base_primitive.py", line 57, in apply self.output = self._perform() File "/local/shawnknabel/anaconda3/envs/kcwidrp/lib/python3.7/site-packages/kcwidrp/primitives/MakeMasterBias.py", line 138, in _perform output_dir=self.config.instrument.output_directory) File "/local/shawnknabel/anaconda3/envs/kcwidrp/lib/python3.7/site-packages/kcwidrp/primitives/kcwi_file_primitives.py", line 717, in kcwi_fits_writer "--tags", "--long"], capture_output=True) File "/local/shawnknabel/anaconda3/envs/kcwidrp/lib/python3.7/subprocess.py", line 488, in run with Popen(*popenargs, kwargs) as process: File "/local/shawnknabel/anaconda3/envs/kcwidrp/lib/python3.7/subprocess.py", line 800, in init restore_signals, start_new_session) File "/local/shawnknabel/anaconda3/envs/kcwidrp/lib/python3.7/subprocess.py", line 1551, in _execute_child raise child_exception_type(errno_num, err_msg, err_filename) FileNotFoundError: [Errno 2] No such file or directory: 'git': 'git' 2022-02-22 16:29:08:DRPF:INFO: Event failed: name bias_make_master, action MakeMasterBias, arg name kb210813_00017.fits, recurr False 2022-02-22 16:29:08:KCWI:INFO: ------------------- Ingesting file kb210813_00018.fits ------------------- 2022-02-22 16:29:08:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00018.fits 2022-02-22 16:29:08:KCWI:INFO: Looking for MBIAS frames 2022-02-22 16:29:08:KCWI:INFO: Camera is BLUE 2022-02-22 16:29:08:KCWI:INFO: Target type is MBIAS 2022-02-22 16:29:08:KCWI:INFO: Looking for frames with CCDCFG = 1111000 2022-02-22 16:29:08:KCWI:INFO: Looking for CONTBARS frames 2022-02-22 16:29:08:KCWI:INFO: Camera is BLUE 2022-02-22 16:29:08:KCWI:INFO: Target type is CONTBARS 2022-02-22 16:29:08:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 16:29:08:KCWI:INFO: Looking for MFLAT frames 2022-02-22 16:29:08:KCWI:INFO: Camera is BLUE 2022-02-22 16:29:08:KCWI:INFO: Target type is MFLAT 2022-02-22 16:29:08:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 16:29:08:KCWI:INFO: Looking for INVSENS frames 2022-02-22 16:29:08:KCWI:INFO: Camera is BLUE 2022-02-22 16:29:08:KCWI:INFO: Target type is INVSENS 2022-02-22 16:29:08:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 16:29:08:KCWI:INFO: Looking for ARCLAMP frames 2022-02-22 16:29:08:KCWI:INFO: Camera is BLUE 2022-02-22 16:29:08:KCWI:INFO: Target type is ARCLAMP 2022-02-22 16:29:08:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 16:29:08:DRPF:INFO: Event completed: name next_file, action ingest_file, arg name kb210813_00018.fits, recurr False 2022-02-22 16:29:08:KCWI:INFO: ** FILE TYPE DETERMINED AS CONTBARS 2022-02-22 16:29:08:KCWI:INFO: GROUPID is 2021-08-13-18 2022-02-22 16:29:08:KCWI:INFO: **** STATEID is BL_small_4600 (6115c23cce9e240a4bee8190) 2022-02-22 16:29:08:DRPF:INFO: Event completed: name file_ingested, action action_planner, arg name kb210813_00018.fits, recurr False 2022-02-22 16:29:08:DRPF:INFO: Event completed: name process_contbars, action ProcessContbars, arg name kb210813_00018.fits, recurr False 2022-02-22 16:29:08:KCWI:INFO: Amp1 Read noise from oscan in e-: 3.687 2022-02-22 16:29:09:KCWI:INFO: Amp2 Read noise from oscan in e-: 3.901 2022-02-22 16:29:10:KCWI:INFO: Amp3 Read noise from oscan in e-: 3.714 2022-02-22 16:29:11:KCWI:INFO: Amp4 Read noise from oscan in e-: 3.580 2022-02-22 16:29:12:KCWI:INFO: kcwidrp.primitives.SubtractOverscan 2022-02-22 16:29:12:DRPF:INFO: Event completed: name contbar_subtract_overscan, action SubtractOverscan, arg name kb210813_00018.fits, recurr False 2022-02-22 16:29:13:KCWI:INFO: kcwidrp.primitives.TrimOverscan 2022-02-22 16:29:13:DRPF:INFO: Event completed: name contbar_trim_overscan, action TrimOverscan, arg name kb210813_00018.fits, recurr False 2022-02-22 16:29:13:KCWI:INFO: Applying gain correction of 0.173 in section [1:2048,1:2056] 2022-02-22 16:29:13:KCWI:INFO: Applying gain correction of 0.181 in section [2049:4096,1:2056] 2022-02-22 16:29:13:KCWI:INFO: Applying gain correction of 0.176 in section [1:2048,2057:4112] 2022-02-22 16:29:13:KCWI:INFO: Applying gain correction of 0.177 in section [2049:4096,2057:4112] 2022-02-22 16:29:13:KCWI:INFO: kcwidrp.primitives.CorrectGain 2022-02-22 16:29:13:DRPF:INFO: Event completed: name contbar_correct_gain, action CorrectGain, arg name kb210813_00018.fits, recurr False 2022-02-22 16:29:13:KCWI:INFO: kcwidrp.primitives.RectifyImage 2022-02-22 16:29:13:DRPF:ERROR: Exception [Errno 2] No such file or directory: 'git': 'git' while invoking RectifyImage Traceback (most recent call last): File "/local/shawnknabel/anaconda3/envs/kcwidrp/lib/python3.7/site-packages/keckdrpframework/core/framework.py", line 229, in execute action_output = pipeline.get_action(action_name)(action, context) File "/local/shawnknabel/anaconda3/envs/kcwidrp/lib/python3.7/site-packages/keckdrpframework/pipelines/base_pipeline.py", line 84, in f return obj.apply() File "/local/shawnknabel/anaconda3/envs/kcwidrp/lib/python3.7/site-packages/keckdrpframework/primitives/base_primitive.py", line 57, in apply self.output = self._perform() File "/local/shawnknabel/anaconda3/envs/kcwidrp/lib/python3.7/site-packages/kcwidrp/primitives/RectifyImage.py", line 89, in _perform suffix="int") File "/local/shawnknabel/anaconda3/envs/kcwidrp/lib/python3.7/site-packages/kcwidrp/primitives/kcwi_file_primitives.py", line 717, in kcwi_fits_writer "--tags", "--long"], capture_output=True) File "/local/shawnknabel/anaconda3/envs/kcwidrp/lib/python3.7/subprocess.py", line 488, in run with Popen(popenargs, kwargs) as process: File "/local/shawnknabel/anaconda3/envs/kcwidrp/lib/python3.7/subprocess.py", line 800, in init restore_signals, start_new_session) File "/local/shawnknabel/anaconda3/envs/kcwidrp/lib/python3.7/subprocess.py", line 1551, in _execute_child raise child_exception_type(errno_num, err_msg, err_filename) FileNotFoundError: [Errno 2] No such file or directory: 'git': 'git' 2022-02-22 16:29:13:DRPF:INFO: Event failed: name contbar_rectify_image, action RectifyImage, arg name kb210813_00018.fits, recurr False 2022-02-22 16:29:13:KCWI:INFO: ------------------- Ingesting file kb210813_00019.fits ------------------- 2022-02-22 16:29:13:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00019.fits 2022-02-22 16:29:13:KCWI:INFO: Looking for MBIAS frames 2022-02-22 16:29:13:KCWI:INFO: Camera is BLUE 2022-02-22 16:29:13:KCWI:INFO: Target type is MBIAS 2022-02-22 16:29:13:KCWI:INFO: Looking for frames with CCDCFG = 1111000 2022-02-22 16:29:13:KCWI:INFO: Looking for CONTBARS frames 2022-02-22 16:29:13:KCWI:INFO: Camera is BLUE 2022-02-22 16:29:13:KCWI:INFO: Target type is CONTBARS 2022-02-22 16:29:13:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 16:29:13:KCWI:INFO: Looking for MFLAT frames 2022-02-22 16:29:13:KCWI:INFO: Camera is BLUE 2022-02-22 16:29:13:KCWI:INFO: Target type is MFLAT 2022-02-22 16:29:13:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 16:29:13:KCWI:INFO: Looking for INVSENS frames 2022-02-22 16:29:13:KCWI:INFO: Camera is BLUE 2022-02-22 16:29:13:KCWI:INFO: Target type is INVSENS 2022-02-22 16:29:13:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 16:29:13:KCWI:INFO: Looking for ARCLAMP frames 2022-02-22 16:29:13:KCWI:INFO: Camera is BLUE 2022-02-22 16:29:13:KCWI:INFO: Target type is ARCLAMP 2022-02-22 16:29:13:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 16:29:13:KCWI:WARNING: Cannot reduce ARCLAMP frame. Missing continuum bars. Rescheduling for later. 2022-02-22 16:29:13:DRPF:INFO: Event failed: name next_file, action ingest_file, arg name kb210813_00019.fits, recurr True 2022-02-22 16:29:13:KCWI:INFO: ------------------- Ingesting file kb210813_00020.fits ------------------- 2022-02-22 16:29:13:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210813_00020.fits 2022-02-22 16:29:13:KCWI:INFO: Looking for MBIAS frames 2022-02-22 16:29:13:KCWI:INFO: Camera is BLUE 2022-02-22 16:29:13:KCWI:INFO: Target type is MBIAS 2022-02-22 16:29:13:KCWI:INFO: Looking for frames with CCDCFG = 1111000 2022-02-22 16:29:13:KCWI:INFO: Looking for CONTBARS frames 2022-02-22 16:29:13:KCWI:INFO: Camera is BLUE 2022-02-22 16:29:13:KCWI:INFO: Target type is CONTBARS 2022-02-22 16:29:13:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 16:29:13:KCWI:INFO: Looking for MFLAT frames 2022-02-22 16:29:13:KCWI:INFO: Camera is BLUE 2022-02-22 16:29:13:KCWI:INFO: Target type is MFLAT 2022-02-22 16:29:13:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 16:29:13:KCWI:INFO: Looking for INVSENS frames 2022-02-22 16:29:13:KCWI:INFO: Camera is BLUE 2022-02-22 16:29:13:KCWI:INFO: Target type is INVSENS 2022-02-22 16:29:13:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 16:29:13:KCWI:INFO: Looking for ARCLAMP frames 2022-02-22 16:29:13:KCWI:INFO: Camera is BLUE 2022-02-22 16:29:13:KCWI:INFO: Target type is ARCLAMP 2022-02-22 16:29:13:KCWI:INFO: Looking for frames with STATEID = 6115c23cce9e240a4bee8190 (BL_small_4600) 2022-02-22 16:29:13:KCWI:WARNING: Cannot reduce ARCLAMP frame. Missing continuum bars. Rescheduling for later. 2022-02-22 16:29:13:DRPF:INFO: Event failed: name next_file, action ingest_file, arg name kb210813_00020.fits, recurr True

MNBrod commented 2 years ago

I have found the problem. The pipeline tries to save what version was used to generate it's reduced data products, but the way it gets that version information doesn't handle every installation method the same. This caused an issue on your machine, and I need to write a workaround to handle it.

It will take me a day or two to fix it though. I will post back here as soon as I do!

shawnknabel commented 2 years ago

Thank you for your help! I eagerly await your next response!

MNBrod commented 2 years ago

I've had a rougher week than expected and wasn't able to get the change pushed out on the time frame I hoped for. As a workaround, if you install git onto your machine, that should solve your problem. The code will be updated to support not having git installed as soon as possible.

shawnknabel commented 2 years ago

Thank you, I've installed git and begun running it on a night's data. I'll let you know if I run into any more issues. I appreciate your assistance!

shawnknabel commented 2 years ago

Hello, I believe it has worked correctly! I have an additional question: What should I be doing when it prompts me for line masking, polynomial order, etc.? This first time, I just pressed "Enter", and it appeared to be prepared to do it's best estimate fitting with no problem. I'm new to data reduction and am unsure what is happening there. If defaulting to the pipeline's decisions is acceptable, is there a way for me to tell it not to prompt me? It would save me having to monitor it constantly as well.

Thank you for all your assistance!

shawnknabel commented 2 years ago

Hi! I've been able to reduce the data for several nights of observation, but one has given me some issues. I'm not sure why, but it seems to me that there may be something missing from the directory that I am downloading from the KCWI server. Do you have any suggestions? Thanks!

In lieu of a full report... here are all the lines that say it failed an event:


2022-03-04 10:57:54:DRPF:INFO: Event failed: name bias_make_master, action MakeMasterBias, arg name kb210507_00001.fits, recurr False

2022-03-04 10:57:54:DRPF:INFO: Event failed: name bias_make_master, action MakeMasterBias, arg name kb210507_00002.fits, recurr False

2022-03-04 10:57:54:DRPF:INFO: Event failed: name bias_make_master, action MakeMasterBias, arg name kb210507_00003.fits, recurr False

2022-03-04 10:57:55:DRPF:INFO: Event failed: name bias_make_master, action MakeMasterBias, arg name kb210507_00004.fits, recurr False

2022-03-04 10:57:55:DRPF:INFO: Event failed: name bias_make_master, action MakeMasterBias, arg name kb210507_00005.fits, recurr False

2022-03-04 10:57:56:DRPF:INFO: Event failed: name bias_make_master, action MakeMasterBias, arg name kb210507_00006.fits, recurr False

2022-03-04 10:57:56:DRPF:INFO: Event failed: name bias_make_master, action MakeMasterBias, arg name kb210507_00007.fits, recurr False

2022-03-04 11:01:33:DRPF:INFO: Event failed: name process_arc, action ProcessArc, arg name kb210507_00017.fits, recurr False

2022-03-04 11:10:09:DRPF:INFO: Event failed: name flat_make_stack, action StackFlats, arg name kb210507_00019.fits, recurr False

2022-03-04 11:10:19:DRPF:INFO: Event failed: name flat_make_stack, action StackFlats, arg name kb210507_00020.fits, recurr False

2022-03-04 11:10:29:DRPF:INFO: Event failed: name flat_make_stack, action StackFlats, arg name kb210507_00021.fits, recurr False

2022-03-04 11:10:40:DRPF:INFO: Event failed: name flat_make_stack, action StackFlats, arg name kb210507_00022.fits, recurr False

2022-03-04 11:10:50:DRPF:INFO: Event failed: name flat_make_stack, action StackFlats, arg name kb210507_00023.fits, recurr False

2022-03-04 11:12:57:DRPF:INFO: Event failed: name flat_make_stack, action StackFlats, arg name kb210507_00025.fits, recurr False

2022-03-04 11:13:39:DRPF:INFO: Event failed: name flat_make_stack, action StackFlats, arg name kb210507_00026.fits, recurr False

2022-03-04 11:19:35:DRPF:INFO: Event failed: name object_make_invsens, action MakeInvsens, arg name kb210507_00028.fits, recurr False

2022-03-04 11:19:35:DRPF:INFO: Event failed: name object_flux_calibrate, action FluxCalibrate, arg name kb210507_00028.fits, recurr False

2022-03-04 11:23:55:DRPF:INFO: Event failed: name object_make_invsens, action MakeInvsens, arg name kb210507_00029.fits, recurr False

2022-03-04 11:23:55:DRPF:INFO: Event failed: name object_flux_calibrate, action FluxCalibrate, arg name kb210507_00029.fits, recurr False

2022-03-04 11:28:17:DRPF:INFO: Event failed: name object_make_invsens, action MakeInvsens, arg name kb210507_00030.fits, recurr False

2022-03-04 11:28:17:DRPF:INFO: Event failed: name object_flux_calibrate, action FluxCalibrate, arg name kb210507_00030.fits, recurr False

2022-03-04 11:32:31:DRPF:INFO: Event failed: name object_make_invsens, action MakeInvsens, arg name kb210507_00031.fits, recurr False

2022-03-04 11:32:31:DRPF:INFO: Event failed: name object_flux_calibrate, action FluxCalibrate, arg name kb210507_00031.fits, recurr False

2022-03-04 11:36:48:DRPF:INFO: Event failed: name object_make_invsens, action MakeInvsens, arg name kb210507_00032.fits, recurr False

2022-03-04 11:36:48:DRPF:INFO: Event failed: name object_flux_calibrate, action FluxCalibrate, arg name kb210507_00032.fits, recurr False

2022-03-04 11:41:08:DRPF:INFO: Event failed: name object_make_invsens, action MakeInvsens, arg name kb210507_00033.fits, recurr False

2022-03-04 11:41:08:DRPF:INFO: Event failed: name object_flux_calibrate, action FluxCalibrate, arg name kb210507_00033.fits, recurr False

2022-03-04 11:45:16:DRPF:INFO: Event failed: name object_make_invsens, action MakeInvsens, arg name kb210507_00034.fits, recurr False

2022-03-04 11:45:16:DRPF:INFO: Event failed: name object_flux_calibrate, action FluxCalibrate, arg name kb210507_00034.fits, recurr False

2022-03-04 11:49:27:DRPF:INFO: Event failed: name object_make_invsens, action MakeInvsens, arg name kb210507_00035.fits, recurr False

2022-03-04 11:49:27:DRPF:INFO: Event failed: name object_flux_calibrate, action FluxCalibrate, arg name kb210507_00035.fits, recurr False

2022-03-04 11:53:10:DRPF:INFO: Event failed: name object_make_invsens, action MakeInvsens, arg name kb210507_00036.fits, recurr False

2022-03-04 11:53:10:DRPF:INFO: Event failed: name object_flux_calibrate, action FluxCalibrate, arg name kb210507_00036.fits, recurr False

2022-03-04 11:56:58:DRPF:INFO: Event failed: name object_make_invsens, action MakeInvsens, arg name kb210507_00037.fits, recurr False

2022-03-04 11:56:58:DRPF:INFO: Event failed: name object_flux_calibrate, action FluxCalibrate, arg name kb210507_00037.fits, recurr False

2022-03-04 12:00:33:DRPF:INFO: Event failed: name object_make_invsens, action MakeInvsens, arg name kb210507_00038.fits, recurr False

2022-03-04 12:00:33:DRPF:INFO: Event failed: name object_flux_calibrate, action FluxCalibrate, arg name kb210507_00038.fits, recurr False

2022-03-04 12:04:18:DRPF:INFO: Event failed: name object_make_invsens, action MakeInvsens, arg name kb210507_00039.fits, recurr False

2022-03-04 12:04:18:DRPF:INFO: Event failed: name object_flux_calibrate, action FluxCalibrate, arg name kb210507_00039.fits, recurr False

2022-03-04 12:07:27:DRPF:INFO: Event failed: name object_make_invsens, action MakeInvsens, arg name kb210507_00040.fits, recurr False

2022-03-04 12:07:27:DRPF:INFO: Event failed: name object_flux_calibrate, action FluxCalibrate, arg name kb210507_00040.fits, recurr False

2022-03-04 12:10:35:DRPF:INFO: Event failed: name object_make_invsens, action MakeInvsens, arg name kb210507_00041.fits, recurr False

2022-03-04 12:10:35:DRPF:INFO: Event failed: name object_flux_calibrate, action FluxCalibrate, arg name kb210507_00041.fits, recurr False

2022-03-04 12:13:51:DRPF:INFO: Event failed: name object_make_invsens, action MakeInvsens, arg name kb210507_00042.fits, recurr False

2022-03-04 12:13:51:DRPF:INFO: Event failed: name object_flux_calibrate, action FluxCalibrate, arg name kb210507_00042.fits, recurr False