STScI-Citizen-Science / MTPipeline

Pipeline to produce CR rejected, astrodrizzled, png's of HST WFPC2 solar system data.
6 stars 1 forks source link

Astrodrizzle not finding DQ files. #17

Closed acviana closed 11 years ago

acviana commented 11 years ago

There is a warning showing up in the astrodrizzle outputs:

==== Processing Step  Separate Drizzle  started at  17:47:36.255 (07/01/2013)
DQ file  /Users/viana/mtpipeline/archive/05221_neptune/u2eu0101t_c0_c1r.fits  NOT found...
Copying  wfpc2_inmask1.fits to  /Users/viana/mtpipeline/archive/05221_neptune/u2eu0101t_c0m_cr_sci1_dqmask.fits  as input mask file.
-Generating simple FITS output: /Users/viana/mtpipeline/archive/05221_neptune/u2eu0101t_c0m_cr_single_sci.fits
Writing out image to disk: /Users/viana/mtpipeline/archive/05221_neptune/u2eu0101t_c0m_cr_single_sci.fits
Writing out image to disk: /Users/viana/mtpipeline/archive/05221_neptune/u2eu0101t_c0m_cr_single_wht.fits
==== Processing Step  Separate Drizzle  finished at  17:47:38.975 (07/01/2013)

I need to figure out how the /Users/viana/mtpipeline/archive/05221_neptune/u2eu0101t_c0_c1r.fits filename is being generated. This seems to only be an issue for the CR rejected files, so it might be the something to do with the filename.

acviana commented 11 years ago

I noticed this when looking at the header files:

--> imhead u2eu0101t_c0m_cr.fits[0] l+ | grep FILENAME
FILENAME= 'u2eu0101t_c0f.fits' / name of file
--> imhead u2eu0101t_c0m.fits[0] l+ | grep FILENAME
FILENAME= 'u2eu0101t_c0f.fits' / name of file

This is incorrect and the same in both the regular and cosmic ray rejected file. Since it's the same in the non-cosmic ray rejected files I don't think it's a result of my cosmic ray rejection script copying the headers into the cosmic ray rejected files. It's also the same in the directories I haven't processed yet. So, I wonder if the files came down that way.

acviana commented 11 years ago

This looks like a string parsing error to me where astrodrizzle expects the filename to be *_c0m.fits. I might be able to fix this by specifying the DQ file as an input parameter.

acviana commented 11 years ago

From Warren Hack:

This issue comes down to what mechanisms were used by the WFPC2 team to link DQ arrays with their science data. The only mechanism available (and used) was the naming convention which was not only used for DQ arrays, but also other calibrated products for a single exposure. With no other alternative, the drizzle code only had the naming convention to rely on to identify the DQ arrays for a given SCI array. No other datasets have separate SCI and DQ images, so there was even less need to try to find a astrodrizzle-specific solution to this problem, leaving only the naming convention to be followed with no manual alternative.

This will require a change in our file naming convention to correct.

acviana commented 11 years ago

Fixed in commit 74043b406ff8fe53ad531ceb531e345a840822dc