'grating undefined' / 'Cannot reduce OBJECT frame.'

[ejarrin]

Hello! I need some help please. I am running the pipeline on Linux, using a conda environment for the kcwidrp. Some of the files are not able to be processed by the pipeline and I haven't achieved to find a solution. Could you please help me understand the following issues? Here's what I get from the terminal:

1) 'grating undefined' and skips from kb200913_00001.fits.gz to kb200913_00011.fits.gz

2022-03-01 01:08:59:KCWI:INFO:kcwi_file_primitives.py: ------------------- Ingesting file kb200913_00001.fits.gz ------------------- 2022-03-01 01:09:00:KCWI:INFO:kcwi_file_primitives.py: <<< read 1 imgs and 1 tables out of 2 hdus in kb200913_00001.fits.gz 2022-03-01 01:09:00:KCWI:INFO:kcwi_proctab.py: Looking for MBIAS frames 2022-03-01 01:09:00:KCWI:INFO:kcwi_proctab.py: Camera is BLUE 2022-03-01 01:09:00:KCWI:INFO:kcwi_proctab.py: Target type is MBIAS 2022-03-01 01:09:00:KCWI:INFO:kcwi_proctab.py: Looking for frames with CCDCFG = 2201009 2022-03-01 01:09:00:KCWI:INFO:kcwi_proctab.py: Looking for CONTBARS frames 2022-03-01 01:09:00:KCWI:INFO:kcwi_proctab.py: Camera is BLUE 2022-03-01 01:09:00:KCWI:INFO:kcwi_proctab.py: Target type is CONTBARS 2022-03-01 01:09:00:KCWI:INFO:kcwi_proctab.py: Looking for frames with STATEID = undefined (undefined) 2022-03-01 01:09:00:KCWI:INFO:kcwi_proctab.py: Looking for MFLAT frames 2022-03-01 01:09:00:KCWI:INFO:kcwi_proctab.py: Camera is BLUE 2022-03-01 01:09:00:KCWI:INFO:kcwi_proctab.py: Target type is MFLAT 2022-03-01 01:09:00:KCWI:INFO:kcwi_proctab.py: Looking for frames with STATEID = undefined (undefined) 2022-03-01 01:09:00:KCWI:INFO:kcwi_proctab.py: Looking for INVSENS frames 2022-03-01 01:09:00:KCWI:INFO:kcwi_proctab.py: Camera is BLUE 2022-03-01 01:09:00:KCWI:INFO:kcwi_proctab.py: Target type is INVSENS 2022-03-01 01:09:00:KCWI:INFO:kcwi_proctab.py: Looking for frames with STATEID = undefined (undefined) 2022-03-01 01:09:00:KCWI:INFO:kcwi_proctab.py: Looking for ARCLAMP frames 2022-03-01 01:09:00:KCWI:INFO:kcwi_proctab.py: Camera is BLUE 2022-03-01 01:09:00:KCWI:INFO:kcwi_proctab.py: Target type is ARCLAMP 2022-03-01 01:09:00:KCWI:INFO:kcwi_proctab.py: Looking for frames with STATEID = undefined (undefined) 2022-03-01 01:09:00:KCWI:WARNING:kcwi_file_primitives.py: UNABLE TO INGEST THE FILE 2022-03-01 01:09:00:KCWI:WARNING:kcwi_file_primitives.py: Reason: unable to compute atlas resolution: grating undefined 2022-03-01 01:09:00:KCWI:WARNING:kcwi_pipeline.py: FILE TYPE is NOT determined. No processing is possible. 2022-03-01 20:18:29:KCWI:INFO:kcwi_file_primitives.py: ------------------- Ingesting file kb200913_00011.fits.gz ------------------- 2022-03-01 20:18:30:KCWI:INFO:kcwi_file_primitives.py: <<< read 1 imgs and 1 tables out of 2 hdus in kb200913_00011.fits.gz 2022-03-01 20:18:30:KCWI:INFO:kcwi_proctab.py: Looking for MBIAS frames 2022-03-01 20:18:30:KCWI:INFO:kcwi_proctab.py: Camera is BLUE 2022-03-01 20:18:30:KCWI:INFO:kcwi_proctab.py: Target type is MBIAS 2022-03-01 20:18:30:KCWI:INFO:kcwi_proctab.py: Looking for frames with CCDCFG = 2201009 2022-03-01 20:18:30:KCWI:INFO:kcwi_proctab.py: Looking for CONTBARS frames 2022-03-01 20:18:30:KCWI:INFO:kcwi_proctab.py: Camera is BLUE 2022-03-01 20:18:30:KCWI:INFO:kcwi_proctab.py: Target type is CONTBARS 2022-03-01 20:18:30:KCWI:INFO:kcwi_proctab.py: Looking for frames with STATEID = 0 (Shared Bias) 2022-03-01 20:18:30:KCWI:INFO:kcwi_proctab.py: Looking for MFLAT frames 2022-03-01 20:18:30:KCWI:INFO:kcwi_proctab.py: Camera is BLUE 2022-03-01 20:18:30:KCWI:INFO:kcwi_proctab.py: Target type is MFLAT 2022-03-01 20:18:30:KCWI:INFO:kcwi_proctab.py: Looking for frames with STATEID = 0 (Shared Bias) 2022-03-01 20:18:30:KCWI:INFO:kcwi_proctab.py: Looking for INVSENS frames 2022-03-01 20:18:30:KCWI:INFO:kcwi_proctab.py: Camera is BLUE 2022-03-01 20:18:30:KCWI:INFO:kcwi_proctab.py: Target type is INVSENS 2022-03-01 20:18:30:KCWI:INFO:kcwi_proctab.py: Looking for frames with STATEID = 0 (Shared Bias) 2022-03-01 20:18:30:KCWI:INFO:kcwi_proctab.py: Looking for ARCLAMP frames 2022-03-01 20:18:30:KCWI:INFO:kcwi_proctab.py: Camera is BLUE 2022-03-01 20:18:30:KCWI:INFO:kcwi_proctab.py: Target type is ARCLAMP 2022-03-01 20:18:30:KCWI:INFO:kcwi_proctab.py: Looking for frames with STATEID = 0 (Shared Bias) 2022-03-01 20:18:30:KCWI:INFO:kcwi_pipeline.py: FILE TYPE DETERMINED AS BIAS 2022-03-01 20:18:30:KCWI:INFO:kcwi_pipeline.py: GROUPID is 2020-09-13-11 2022-03-01 20:18:30:KCWI:INFO:kcwi_pipeline.py: STATEID is Shared Bias (0) 2022-03-01 20:18:30:KCWI:WARNING:kcwi_pipeline.py: Already processed (already in proctab) 2022-03-01 20:18:30:KCWI:WARNING:kcwi_pipeline.py: Pushing noop to queue

2) Cannot reduce OBJECT frame:

2022-03-01 20:18:39:KCWI:INFO:kcwi_file_primitives.py: ------------------- Ingesting file kb200913_00041.fits.gz ------------------- 2022-03-01 20:18:40:KCWI:INFO:kcwi_file_primitives.py: <<< read 1 imgs and 1 tables out of 2 hdus in kb200913_00041.fits.gz 2022-03-01 20:18:40:KCWI:INFO:kcwi_proctab.py: Looking for MBIAS frames 2022-03-01 20:18:40:KCWI:INFO:kcwi_proctab.py: Camera is BLUE 2022-03-01 20:18:40:KCWI:INFO:kcwi_proctab.py: Target type is MBIAS 2022-03-01 20:18:40:KCWI:INFO:kcwi_proctab.py: Looking for frames with CCDCFG = 2201009 2022-03-01 20:18:40:KCWI:INFO:kcwi_proctab.py: Looking for CONTBARS frames 2022-03-01 20:18:40:KCWI:INFO:kcwi_proctab.py: Camera is BLUE 2022-03-01 20:18:40:KCWI:INFO:kcwi_proctab.py: Target type is CONTBARS 2022-03-01 20:18:40:KCWI:INFO:kcwi_proctab.py: Looking for frames with STATEID = 5f5d799ace9e24643c7b0098 (EL_L_4600) 2022-03-01 20:18:40:KCWI:INFO:kcwi_proctab.py: Looking for MFLAT frames 2022-03-01 20:18:40:KCWI:INFO:kcwi_proctab.py: Camera is BLUE 2022-03-01 20:18:40:KCWI:INFO:kcwi_proctab.py: Target type is MFLAT 2022-03-01 20:18:40:KCWI:INFO:kcwi_proctab.py: Looking for frames with STATEID = 5f5d799ace9e24643c7b0098 (EL_L_4600) 2022-03-01 20:18:40:KCWI:INFO:kcwi_proctab.py: Looking for INVSENS frames 2022-03-01 20:18:40:KCWI:INFO:kcwi_proctab.py: Camera is BLUE 2022-03-01 20:18:40:KCWI:INFO:kcwi_proctab.py: Target type is INVSENS 2022-03-01 20:18:40:KCWI:INFO:kcwi_proctab.py: Looking for frames with STATEID = 5f5d799ace9e24643c7b0098 (EL_L_4600) 2022-03-01 20:18:40:KCWI:INFO:kcwi_proctab.py: Looking for ARCLAMP frames 2022-03-01 20:18:40:KCWI:INFO:kcwi_proctab.py: Camera is BLUE 2022-03-01 20:18:40:KCWI:INFO:kcwi_proctab.py: Target type is ARCLAMP 2022-03-01 20:18:40:KCWI:INFO:kcwi_proctab.py: Looking for frames with STATEID = 5f5d799ace9e24643c7b0098 (EL_L_4600) 2022-03-01 20:18:40:KCWI:WARNING:kcwi_file_primitives.py: Cannot reduce OBJECT frame. Rescheduling for later. Found: 2022-03-01 20:18:40:KCWI:WARNING:kcwi_file_primitives.py: MBIAS: 1 2022-03-01 20:18:40:KCWI:WARNING:kcwi_file_primitives.py: MFLAT: 0 2022-03-01 20:18:40:KCWI:WARNING:kcwi_file_primitives.py: ARCLAMP: 1 2022-03-01 20:18:40:KCWI:INFO:kcwi_file_primitives.py: ------------------- Ingesting file kb200913_00042.fits.gz -------------------

etc...

Thanks a lot for your time!

[rmcgurk]

Hello,

For your first issue, frames 1-10 are afternoon calibration files, and are not reduce-able by the pipeline. So that is not a surprise. From your log, frame 11 was successfully identified by the pipeline as a Shared Bias and will be reduced once the pipeline finds all 7 bias frames.

For your second issue, it looks like somehow the pipeline didn't make a Master Flat, or mflat. Can you check the files created and see if you see an "mflat" ending on any of them? And can you confirm if the mflat was missing ONLY for frame 41 or if it is missing for all science frames?

Thanks, Rosalie

[ejarrin]

Thank you for your response and the clarification! As you could see, I was running the pipeline using compressed files, namely ".fits.gz files." I ran the pipeline again but this time using just .fits files and it successfully processed them all. Before I was missing MFLAT for all the science frames but now I did not get that error and I can see that all files have been entered in the kcwi.proc file.

I only have one last question please! In the redux directory, I only have one file with a .mflat ending but the rest do not have. Are there supposed to be more?

Thank you so much for your patience!

[rmcgurk]

Hi,

You should only have one mflat, since it is the master flat that combines the light from all the individual flats to make the best flat.

I'm glad you got the pipeline to process your data!

Cheers, Rosalie