Completeness test

[walyssonBarbosa]

Here is what I am adding to/changing in the pipeline:

• Reorganized and changed imaging_pipeline.py to cover the new png files.
• Added a test to se if make_output_dict in imaging_pipeline.py is correctly working.
• Created a script setup_logging.py to do the set up for logging.
• Created a script check_filesystem_compleness.py to look for missing files.
• Created the settings.yaml and the template for it.
• Reorganized the file tree.

[acviana]

Hi Wally, one request while I'm looking over your new code. If you haven't already done so could you look through one of the directories with missing data and do a spot check to confirm that our missing data numbers are correct?

[walyssonBarbosa]

I checked the directory /astro/3/mutchler/mt/drizzled/05489_vesta/ to see if the 18 files were really missing. I run:

cd /astro/3/mutchler/mt/drizzled/05489_vesta/
ls | grep -c c0m_wide_single_sci.fits
ls | grep -c c0m_center_single_sci.fits
ls | grep -c c0m_center_single_wht.fits
ls | grep -c c0m_wide_single_wht.fits 
ls png/ | grep -c c0m_wide_single_sci_linear.png
ls png/ | grep -c c0m_center_single_sci_linear.png
ls png/ | grep -c c0m_wide_single_sci_linear_1.png
ls png/ | grep -c c0m_wide_single_sci_linear_2.png
ls png/ | grep -c c0m_wide_single_sci_linear_3.png
ls png/ | grep -c c0m_wide_single_sci_linear_4.png
ls png/ | grep -c c0m_wide_single_sci_linear_5.png
ls png/ | grep -c c0m_wide_single_sci_linear_6.png
ls png/ | grep -c c0m_wide_single_sci_linear_7.png
ls png/ | grep -c c0m_wide_single_sci_linear_8.png
ls png/ | grep -c c0m_wide_single_sci_linear_9.png
ls png/ | grep -c c0m_wide_single_sci_linear_10.png
ls png/ | grep -c c0m_wide_single_sci_linear_11.png
ls png/ | grep -c c0m_wide_single_sci_linear_12.png

The output expected for each count was 112, instead it resulted in 111. So these are the quantity of missing files:

drizzle_weight : 2
drizzle_output : 2
png_output : 14