Keck-DataReductionPipelines / KCWI_DRP

KCWI python DRP
BSD 3-Clause "New" or "Revised" License
8 stars 12 forks source link

Runtime problem #89

Closed rgriffiths1947 closed 3 years ago

rgriffiths1947 commented 3 years ago

__(py37) PS C:\Users\mcken\OneDrive\Documents\KECK_Data> reduce_kcwi -f kb.fits 2021-07-13 16:42:37,380 Starting Bokeh server version 2.0.2 (running on Tornado 6.1) 2021-07-13 16:42:37,382 User authentication hooks NOT provided (default user enabled) 2021-07-13 16:42:37,386 Bokeh app running at: http://localhost:5006/ 2021-07-13 16:42:37,386 Starting Bokeh server with process id: 26316 2021-07-13 16:42:41:KCWI:INFO: proc table file not found: kcwi.proc 2021-07-13 16:42:41:DRPF:INFO: Framework initialized 2021-07-13 16:42:41:DRPF:WARNING: kb.fits is not a file 2021-07-13 16:42:41:DRPF:INFO: Framework main loop started 2021-07-13 16:42:41,365 WebSocket connection opened 2021-07-13 16:42:41,367 ServerConnection created 2021-07-13 16:42:41:KCWI:INFO: Enabling BOKEH plots 2021-07-13 16:42:41:DRPF:INFO: Event completed: name start_bokeh, action StartBokeh, arg name undef, recurr False 2021-07-13 16:42:41,842 WebSocket connection opened 2021-07-13 16:42:41,842 ServerConnection created 2021-07-13 16:42:42:DRPF:INFO: No new events - do nothing 2021-07-13 16:42:42:DRPF:INFO: Exiting main loop 2021-07-13 16:42:42,622 WebSocket connection closed: code=None, reason=None

We can't find much information about the kcwi.proc file that is stated to be missing other than that it is used to keep track of the files being processed, and that it should be stored in the current directory. It would make sense that this file would be created automatically when we try to run the pipeline. Why is it stated that kb.fits isn't a file ? - since that should reference all the data files in the current directory, and when we use kb.fits with another command (such as "ls kb*.fits") it seems to reference the data files just fine.

When we try to run the command "reduce_kcwi -f" with a specific data file, there are again no files generated in the redux or plots folders, and the terminal first outputs this:

(py37) PS C:\Users\mcken\OneDrive\Documents\KECK_Data> reduce_kcwi -f kb210609_00055.fits 2021-07-13 16:15:16:KCWI:INFO: proc table file not found: kcwi.proc 2021-07-13 16:15:16:DRPF:INFO: Framework initialized 2021-07-13 16:15:17:DRPF:INFO: Framework main loop started 2021-07-13 16:15:17,157 WebSocket connection opened 2021-07-13 16:15:17,157 ServerConnection created 2021-07-13 16:15:17:KCWI:INFO: Enabling BOKEH plots 2021-07-13 16:15:17:DRPF:INFO: Event completed: name start_bokeh, action StartBokeh, arg name undef, recurr False

And then repeatedly outputs this in a loop:

2021-07-13 16:15:17:KCWI:INFO: ------------------- Ingesting file kb210609_00055.fits ------------------- 2021-07-13 16:15:17:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210609_00055.fits 2021-07-13 16:15:17:KCWI:INFO: Looking for MBIAS frames 2021-07-13 16:15:17:KCWI:INFO: Camera is BLUE 2021-07-13 16:15:17:KCWI:INFO: Target type is MBIAS 2021-07-13 16:15:17:KCWI:INFO: Looking for frames with CCDCFG = 2201009 2021-07-13 16:15:17:KCWI:INFO: Looking for CONTBARS frames 2021-07-13 16:15:17:KCWI:INFO: Camera is BLUE 2021-07-13 16:15:17:KCWI:INFO: Target type is CONTBARS 2021-07-13 16:15:17:KCWI:INFO: Looking for frames with STATEID = 60c04c42ce9e241c20199566 (DESI) 2021-07-13 16:15:17:KCWI:INFO: Looking for MFLAT frames 2021-07-13 16:15:17:KCWI:INFO: Camera is BLUE 2021-07-13 16:15:17:KCWI:INFO: Target type is MFLAT 2021-07-13 16:15:17:KCWI:INFO: Looking for frames with STATEID = 60c04c42ce9e241c20199566 (DESI) 2021-07-13 16:15:17:KCWI:INFO: Looking for INVSENS frames 2021-07-13 16:15:17:KCWI:INFO: Camera is BLUE 2021-07-13 16:15:17:KCWI:INFO: Target type is INVSENS 2021-07-13 16:15:17:KCWI:INFO: Looking for frames with STATEID = 60c04c42ce9e241c20199566 (DESI) 2021-07-13 16:15:17:KCWI:INFO: Looking for ARCLAMP frames 2021-07-13 16:15:17:KCWI:INFO: Camera is BLUE 2021-07-13 16:15:17:KCWI:INFO: Target type is ARCLAMP 2021-07-13 16:15:17:KCWI:INFO: Looking for frames with STATEID = 60c04c42ce9e241c20199566 (DESI) 2021-07-13 16:15:17:KCWI:WARNING: Cannot reduce OBJECT frame. Rescheduling for later. Found: 2021-07-13 16:15:17:KCWI:WARNING: MBIAS: 0 2021-07-13 16:15:17:KCWI:WARNING: MFLAT: 0 2021-07-13 16:15:17:KCWI:WARNING: ARCLAMP: 0 2021-07-13 16:15:17:DRPF:INFO: Event failed: name next_file, action ingest_file, arg name kb210609_00055.fits, recurr True

MNBrod commented 3 years ago

Just to gather information, can you tell me the output of ls kb*.fits?

Also, can you try running reduce_kcwi -f kb*.fits -g? the --group option might help (it also might not, but it's worth a shot).

MNBrod commented 3 years ago

Closing this issue, since it is being continued in #94