search

Keck-DataReductionPipelines / KCWI_DRP

KCWI python DRP
BSD 3-Clause "New" or "Revised" License
9 stars 13 forks source link

creation/modification of a kcwi.sky file does not yield new redux if clobber=True #48

Open astronomeara opened 3 years ago

astronomeara commented 3 years ago

Workflow:

  1. Run pipeline to end
  2. Create a kiwi.sky file kb210211_00048.fits kb210211_00051.fits
  3. reduce_kcwi -f kb210211_00048.fits

  4. 2021-04-13 09:32:29:DRPF:INFO: 2021-04-13 09:32:29:DRPF:INFO: Initialization Framework cwd=/Users/jomeara/work/KCWI_0221_python_orig 2021-04-13 09:32:31:KCWI:INFO: reading proc table file: kcwi.proc 2021-04-13 09:32:31:DRPF:INFO: Framework initialized 2021-04-13 09:32:31:DRPF:INFO: Framework main loop started 2021-04-13 09:32:31:KCWI:INFO: Enabling BOKEH plots 2021-04-13 09:32:32:DRPF:INFO: Event completed: name start_bokeh, action StartBokeh, arg name undef, recurr False 2021-04-13 09:32:32:KCWI:INFO: ------------------- Ingesting file kb210211_00048.fits ------------------- 2021-04-13 09:32:32:KCWI:INFO: <<< read 1 imgs and 1 tables out of 2 hdus in kb210211_00048.fits 2021-04-13 09:32:32:DRPF:INFO: Event completed: name next_file, action ingest_file, arg name kb210211_00048.fits, recurr False 2021-04-13 09:32:32:DRPF:INFO: FILE TYPE DETERMINED AS OBJECT 2021-04-13 09:32:32:DRPF:INFO: GROUPID is 2021-02-11-48 2021-04-13 09:32:32:DRPF:WARNING: Already processed (already in proctab) 2021-04-13 09:32:32:DRPF:WARNING: Pushing noop to queue 2021-04-13 09:32:32:DRPF:INFO: Event failed: name file_ingested, action action_planner, arg name kb210211_00048.fits, recurr False 2021-04-13 09:32:32:DRPF:INFO: Event completed: name noop, action noop, arg name kb210211_00048.fits, recurr False 2021-04-13 09:32:33:DRPF:INFO: No new events - do nothing 2021-04-13 09:32:33:DRPF:INFO: Exiting main loop

So, even though clobber=True in the .cfg file, the pipeline is not seeing the new kcwi.sky file and re-reducing that frame w/ new sky frame....

lucarizzi commented 3 years ago

I think I know what is going on: it might be that kcwi.proc overrides the clobber thingy. I will verify. This is now high priority and assigned to me.