search

Keck-DataReductionPipelines / MosfireDRP

http://keck-datareductionpipelines.github.io/MosfireDRP
10 stars 13 forks source link

To process a list of files listing all files with theabsolute path. #146

Open monodera opened 3 years ago

monodera commented 3 years ago

When the files of, e.g., Flat.txt and FlatThermal.txt, are listed as the absolute paths, the current list_file_to_strings in IO.py ignores the first file. The pull request take care such cases.

I tried with the following files:

Flat_multi.txt

# Created by 'monodera' on Mon Nov 30 14:13:06 2020
/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0036.fits
/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0037.fits
/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0038.fits
/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0039.fits
/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0040.fits
/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0041.fits
/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0042.fits
/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0043.fits
/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0044.fits
/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0045.fits
/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0046.fits
/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0047.fits
/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0048.fits

FlatThermal_multi.txt

# Created by 'monodera' on Mon Nov 30 14:13:06 2020
/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0049.fits
/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0050.fits
/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0051.fits
/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0052.fits
/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0053.fits
/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0054.fits
/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0055.fits
/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0056.fits
/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0057.fits
/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0058.fits
/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0059.fits
/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0060.fits
/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0061.fits

Driver.py


import matplotlib

matplotlib.use("TkAgg") # Force TkAgg backend for interactivity. This is

critical to bypass a bug in the MacOSX backend.

import os import time import logging

logger = logging.getLogger(name)

import MOSFIRE from MOSFIRE import ( Background, Combine, Detector, Flats, IO, Options, Rectify, Wavelength, Extract, ) from MOSFIRE.MosfireDrpLog import info, debug, warning, error

import numpy as np

np.seterr(all="ignore")

flatops = Options.flat waveops = Options.wavelength

Driver file automatically generated on Sun Nov 29 19:43:30 2020

If you have questions, please submit a ticket on the github issue page:

https://github.com/Keck-DataReductionPipelines/MosfireDRP/issues

Alternatively, email the developers at mosfiredrp@gmail.com

maskname = "SXDS2_19838" band = "K"

Flats.handle_flats("Flat.txt", maskname, band, flatops, lampOffList="FlatThermal.txt")


With the current release, the log file looks like the following.

2020-12-03 23:45:26,782 - MosfireDrpLog. - INFO: 3.6.3 | packaged by conda-forge | (default, Dec 9 2017, 16:20:51) [GCC 4.2.1 Compatible Apple LLVM 6.1.0 (clang-602.0.53)] 2020-12-03 23:45:26,782 - MosfireDrpLog. - INFO: python version = 3.6.3 2020-12-03 23:45:26,782 - MosfireDrpLog. - INFO: numpy version = 1.13.3 2020-12-03 23:45:26,782 - MosfireDrpLog. - INFO: matplotlib version = 3.1.0 2020-12-03 23:45:26,782 - MosfireDrpLog. - INFO: astropy version = 2.0.3 2020-12-03 23:45:26,782 - MosfireDrpLog. - INFO: ccdproc version = 1.3.0.post1 2020-12-03 23:45:26,893 - IO.list_file_to_strings - DEBUG: Loading: Flat_multi.txt 2020-12-03 23:45:26,894 - Flats. handle_flats - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0037.fits 2020-12-03 23:45:26,894 - Flats. handle_flats - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0038.fits 2020-12-03 23:45:26,894 - Flats. handle_flats - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0039.fits 2020-12-03 23:45:26,894 - Flats. handle_flats - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0040.fits 2020-12-03 23:45:26,894 - Flats. handle_flats - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0041.fits 2020-12-03 23:45:26,894 - Flats. handle_flats - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0042.fits 2020-12-03 23:45:26,894 - Flats. handle_flats - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0043.fits 2020-12-03 23:45:26,894 - Flats. handle_flats - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0044.fits 2020-12-03 23:45:26,895 - Flats. handle_flats - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0045.fits 2020-12-03 23:45:26,895 - Flats. handle_flats - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0046.fits 2020-12-03 23:45:26,895 - Flats. handle_flats - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0047.fits 2020-12-03 23:45:26,895 - Flats. handle_flats - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0048.fits 2020-12-03 23:45:26,917 - IO. readmosfits - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0037.fits contains a DATASEC keyword not compatible with the pipeline 2020-12-03 23:45:26,917 - IO. readmosfits - DEBUG: The content of the keyword will be erased on the reduced data 2020-12-03 23:45:26,998 - IO. readmosfits - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0038.fits contains a DATASEC keyword not compatible with the pipeline 2020-12-03 23:45:26,998 - IO. readmosfits - DEBUG: The content of the keyword will be erased on the reduced data 2020-12-03 23:45:27,077 - IO. readmosfits - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0039.fits contains a DATASEC keyword not compatible with the pipeline 2020-12-03 23:45:27,078 - IO. readmosfits - DEBUG: The content of the keyword will be erased on the reduced data 2020-12-03 23:45:27,168 - IO. readmosfits - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0040.fits contains a DATASEC keyword not compatible with the pipeline 2020-12-03 23:45:27,168 - IO. readmosfits - DEBUG: The content of the keyword will be erased on the reduced data 2020-12-03 23:45:27,247 - IO. readmosfits - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0041.fits contains a DATASEC keyword not compatible with the pipeline 2020-12-03 23:45:27,248 - IO. readmosfits - DEBUG: The content of the keyword will be erased on the reduced data 2020-12-03 23:45:27,328 - IO. readmosfits - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0042.fits contains a DATASEC keyword not compatible with the pipeline 2020-12-03 23:45:27,328 - IO. readmosfits - DEBUG: The content of the keyword will be erased on the reduced data 2020-12-03 23:45:27,409 - IO. readmosfits - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0043.fits contains a DATASEC keyword not compatible with the pipeline 2020-12-03 23:45:27,409 - IO. readmosfits - DEBUG: The content of the keyword will be erased on the reduced data 2020-12-03 23:45:27,493 - IO. readmosfits - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0044.fits contains a DATASEC keyword not compatible with the pipeline 2020-12-03 23:45:27,493 - IO. readmosfits - DEBUG: The content of the keyword will be erased on the reduced data 2020-12-03 23:45:27,575 - IO. readmosfits - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0045.fits contains a DATASEC keyword not compatible with the pipeline 2020-12-03 23:45:27,575 - IO. readmosfits - DEBUG: The content of the keyword will be erased on the reduced data 2020-12-03 23:45:27,654 - IO. readmosfits - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0046.fits contains a DATASEC keyword not compatible with the pipeline 2020-12-03 23:45:27,654 - IO. readmosfits - DEBUG: The content of the keyword will be erased on the reduced data 2020-12-03 23:45:27,734 - IO. readmosfits - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0047.fits contains a DATASEC keyword not compatible with the pipeline 2020-12-03 23:45:27,734 - IO. readmosfits - DEBUG: The content of the keyword will be erased on the reduced data 2020-12-03 23:45:27,814 - IO. readmosfits - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0048.fits contains a DATASEC keyword not compatible with the pipeline 2020-12-03 23:45:27,814 - IO. readmosfits - DEBUG: The content of the keyword will be erased on the reduced data 2020-12-03 23:45:27,875 - Flats. handle_flats - INFO: Attempting to combine files in ['/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0037.fits', '/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0038.fits', '/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0039.fits', '/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0040.fits', '/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0041.fits', '/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0042.fits', '/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0043.fits', '/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0044.fits', '/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0045.fits', '/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0046.fits', '/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0047.fits', '/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0048.fits'] 2020-12-03 23:45:27,875 - IO. imcombine - INFO: Combining files using ccdproc.combine task 2020-12-03 23:45:27,875 - IO. imcombine - INFO: reject=clip_extrema 2020-12-03 23:45:27,875 - IO. imcombine - INFO: nlow=1 2020-12-03 23:45:27,875 - IO. imcombine - INFO: nhigh=1 2020-12-03 23:45:27,875 - IO. imcombine - INFO: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0037.fits 2020-12-03 23:45:27,875 - IO. imcombine - INFO: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0038.fits 2020-12-03 23:45:27,876 - IO. imcombine - INFO: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0039.fits 2020-12-03 23:45:27,876 - IO. imcombine - INFO: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0040.fits 2020-12-03 23:45:27,876 - IO. imcombine - INFO: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0041.fits 2020-12-03 23:45:27,876 - IO. imcombine - INFO: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0042.fits 2020-12-03 23:45:27,876 - IO. imcombine - INFO: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0043.fits 2020-12-03 23:45:27,876 - IO. imcombine - INFO: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0044.fits 2020-12-03 23:45:27,876 - IO. imcombine - INFO: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0045.fits 2020-12-03 23:45:27,876 - IO. imcombine - INFO: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0046.fits 2020-12-03 23:45:27,876 - IO. imcombine - INFO: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0047.fits 2020-12-03 23:45:27,876 - IO. imcombine - INFO: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0048.fits 2020-12-03 23:45:33,140 - IO. imcombine - INFO: Done. 2020-12-03 23:45:33,140 - Flats. handle_flats - INFO: *** Attempting to combine Lamps off files in FlatThermal_multi.txt 2020-12-03 23:45:33,140 - IO.list_file_to_strings - DEBUG: Loading: FlatThermal_multi.txt 2020-12-03 23:45:33,141 - Flats. handle_flats - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0050.fits 2020-12-03 23:45:33,141 - Flats. handle_flats - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0051.fits 2020-12-03 23:45:33,141 - Flats. handle_flats - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0052.fits 2020-12-03 23:45:33,141 - Flats. handle_flats - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0053.fits 2020-12-03 23:45:33,141 - Flats. handle_flats - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0054.fits 2020-12-03 23:45:33,141 - Flats. handle_flats - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0055.fits 2020-12-03 23:45:33,141 - Flats. handle_flats - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0056.fits 2020-12-03 23:45:33,141 - Flats. handle_flats - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0057.fits 2020-12-03 23:45:33,141 - Flats. handle_flats - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0058.fits 2020-12-03 23:45:33,142 - Flats. handle_flats - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0059.fits 2020-12-03 23:45:33,142 - Flats. handle_flats - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0060.fits 2020-12-03 23:45:33,142 - Flats. handle_flats - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0061.fits 2020-12-03 23:45:33,142 - IO. imcombine - INFO: Combining files using ccdproc.combine task 2020-12-03 23:45:33,142 - IO. imcombine - INFO: reject=clip_extrema 2020-12-03 23:45:33,142 - IO. imcombine - INFO: nlow=1 2020-12-03 23:45:33,142 - IO. imcombine - INFO: nhigh=1 2020-12-03 23:45:33,142 - IO. imcombine - INFO: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0050.fits 2020-12-03 23:45:33,142 - IO. imcombine - INFO: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0051.fits 2020-12-03 23:45:33,142 - IO. imcombine - INFO: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0052.fits 2020-12-03 23:45:33,142 - IO. imcombine - INFO: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0053.fits 2020-12-03 23:45:33,142 - IO. imcombine - INFO: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0054.fits 2020-12-03 23:45:33,142 - IO. imcombine - INFO: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0055.fits 2020-12-03 23:45:33,143 - IO. imcombine - INFO: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0056.fits 2020-12-03 23:45:33,143 - IO. imcombine - INFO: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0057.fits 2020-12-03 23:45:33,143 - IO. imcombine - INFO: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0058.fits 2020-12-03 23:45:33,143 - IO. imcombine - INFO: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0059.fits 2020-12-03 23:45:33,143 - IO. imcombine - INFO: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0060.fits 2020-12-03 23:45:33,143 - IO. imcombine - INFO: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0061.fits 2020-12-03 23:45:37,760 - IO. imcombine - INFO: Done. 2020-12-03 23:45:37,760 - IO. imarith - INFO: combflat_2d_K.fits - combflat_lamps_off_2d_K.fits -> combflat_lamps_on_2d_K.fits 2020-12-03 23:45:37,964 - Flats. handle_flats - DEBUG: Combined '['/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0037.fits', '/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0038.fits', '/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0039.fits', '/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0040.fits', '/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0041.fits', '/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0042.fits', '/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0043.fits', '/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0044.fits', '/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0045.fits', '/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0046.fits', '/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0047.fits', '/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0048.fits']' to 'SXDS2_19838' 2020-12-03 23:45:37,964 - Flats. handle_flats - DEBUG: Using on-off flat for K band 2020-12-03 23:45:37,991 - IO. readfits - DEBUG: combflat_lamps_on_2d_K.fits contains a DATASEC keyword not compatible with the pipeline 2020-12-03 23:45:37,991 - IO. readfits - DEBUG: The content of the keyword will be erased on the reduced data 2020-12-03 23:45:37,997 - Flats. handle_flats - INFO: Flat written to combflat_lamps_on_2d_K.fits 2020-12-03 23:45:37,997 - Flats. handle_flats - INFO: Finding slit edges in combflat_lamps_on_2d_K.fits 2020-12-03 23:45:38,029 - Flats. find_and_fit_edges - INFO: [00] Finding Slit Edges for SXDS2_19997 ending at 1857. Slit composed of 4 CSU slits 2020-12-03 23:45:38,029 - Flats. find_and_fit_edges - INFO: [00] Threshold used is 8886.7 2020-12-03 23:45:38,290 - Flats. find_and_fit_edges - INFO: [01] Finding Slit Edges for SXDS2_19229 ending at 1680. Slit composed of 4 CSU slits 2020-12-03 23:45:38,290 - Flats. find_and_fit_edges - INFO: [01] Threshold used is 9709.7 2020-12-03 23:45:38,539 - Flats. find_and_fit_edges - INFO: [02] Finding Slit Edges for SXDS2_19981 ending at 1547. Slit composed of 3 CSU slits 2020-12-03 23:45:38,540 - Flats. find_and_fit_edges - INFO: [02] Threshold used is 9459.7 2020-12-03 23:45:38,763 - Flats. find_and_fit_edges - INFO: [03] Finding Slit Edges for SXDS2_18545 ending at 1458. Slit composed of 2 CSU slits 2020-12-03 23:45:38,763 - Flats. find_and_fit_edges - INFO: [03] Threshold used is 8619.3 2020-12-03 23:45:39,005 - Flats. find_and_fit_edges - INFO: [04] Finding Slit Edges for SXDS2_17233 ending at 1370. Slit composed of 2 CSU slits 2020-12-03 23:45:39,005 - Flats. find_and_fit_edges - INFO: [04] Threshold used is 8204.8 2020-12-03 23:45:39,247 - Flats. find_and_fit_edges - INFO: [05] Finding Slit Edges for SXDS2_19333 ending at 1193. Slit composed of 4 CSU slits 2020-12-03 23:45:39,247 - Flats. find_and_fit_edges - INFO: [05] Threshold used is 8924.4 2020-12-03 23:45:39,501 - Flats. find_and_fit_edges - INFO: [06] Finding Slit Edges for SXDS2_18880 ending at 1104. Slit composed of 2 CSU slits 2020-12-03 23:45:39,501 - Flats. find_and_fit_edges - INFO: [06] Threshold used is 8810.3 2020-12-03 23:45:39,716 - Flats. find_and_fit_edges - INFO: [07] Finding Slit Edges for SXDS2_16609 ending at 972. Slit composed of 3 CSU slits 2020-12-03 23:45:39,716 - Flats. find_and_fit_edges - INFO: [07] Threshold used is 7685.4 2020-12-03 23:45:39,951 - Flats. find_and_fit_edges - INFO: [08] Finding Slit Edges for SXDS2_19221 ending at 883. Slit composed of 2 CSU slits 2020-12-03 23:45:39,951 - Flats. find_and_fit_edges - INFO: [08] Threshold used is 8700.9 2020-12-03 23:45:40,187 - Flats. find_and_fit_edges - INFO: [09] Finding Slit Edges for SXDS2_18406 ending at 795. Slit composed of 2 CSU slits 2020-12-03 23:45:40,187 - Flats. find_and_fit_edges - INFO: [09] Threshold used is 8940.8 2020-12-03 23:45:40,429 - Flats. find_and_fit_edges - INFO: [10] Finding Slit Edges for SXDS2_17265 ending at 750. Slit composed of 1 CSU slits 2020-12-03 23:45:40,429 - Flats. find_and_fit_edges - INFO: [10] Threshold used is 8381.3 2020-12-03 23:45:40,695 - Flats. find_and_fit_edges - INFO: [11] Finding Slit Edges for SXDS2_19838 ending at 662. Slit composed of 2 CSU slits 2020-12-03 23:45:40,695 - Flats. find_and_fit_edges - INFO: [11] Threshold used is 8571.5 2020-12-03 23:45:40,833 - Flats. find_edge_pair - INFO: Skipping wavelength pixel): 341 2020-12-03 23:45:41,270 - Flats. find_and_fit_edges - INFO: [12] Finding Slit Edges for SXDS2_19791 ending at 573. Slit composed of 2 CSU slits 2020-12-03 23:45:41,270 - Flats. find_and_fit_edges - INFO: [12] Threshold used is 8477.5 2020-12-03 23:45:41,438 - Flats. find_and_fit_edges - INFO: [13] Finding Slit Edges for SXDS2_15659 ending at 485. Slit composed of 2 CSU slits 2020-12-03 23:45:41,438 - Flats. find_and_fit_edges - INFO: [13] Threshold used is 7030.0 2020-12-03 23:45:41,699 - Flats. find_and_fit_edges - INFO: [14] Finding Slit Edges for SXDS2_17094 ending at 396. Slit composed of 2 CSU slits 2020-12-03 23:45:41,699 - Flats. find_and_fit_edges - INFO: [14] Threshold used is 8216.5 2020-12-03 23:45:41,961 - Flats. find_and_fit_edges - INFO: [15] Finding Slit Edges for SXDS2_18415 ending at 352. Slit composed of 1 CSU slits 2020-12-03 23:45:41,961 - Flats. find_and_fit_edges - INFO: [15] Threshold used is 9117.7 2020-12-03 23:45:42,186 - Flats. find_and_fit_edges - INFO: [16] Finding Slit Edges for SXDS2_19510 ending at 264. Slit composed of 2 CSU slits 2020-12-03 23:45:42,186 - Flats. find_and_fit_edges - INFO: [16] Threshold used is 8324.0 2020-12-03 23:45:42,449 - Flats. find_and_fit_edges - INFO: [17] Finding Slit Edges for CALIB_SXDS2_19063 ending at 175. Slit composed of 2 CSU slits 2020-12-03 23:45:42,449 - Flats. find_and_fit_edges - INFO: [17] Threshold used is 8265.5 2020-12-03 23:45:42,630 - Flats. find_and_fit_edges - INFO: [18] Finding Slit Edges for SXDS2_15791 ending at 87. Slit composed of 2 CSU slits 2020-12-03 23:45:42,631 - Flats. find_and_fit_edges - INFO: [18] Threshold used is 7684.2 2020-12-03 23:45:42,890 - Flats. find_and_fit_edges - INFO: [19] Finding Slit Edges for SXDS2_16653 ending at 1. Slit composed of 2 CSU slits 2020-12-03 23:45:42,890 - Flats. find_and_fit_edges - INFO: [19] Threshold used is 8507.0 2020-12-03 23:45:43,074 - Flats. make_pixel_flat - INFO: SXDS2_19997] Bounding top/bottom: 1862/2034 2020-12-03 23:45:43,086 - Flats. make_pixel_flat - INFO: SXDS2_19229] Bounding top/bottom: 1685/1851 2020-12-03 23:45:43,098 - Flats. make_pixel_flat - INFO: SXDS2_19981] Bounding top/bottom: 1553/1675 2020-12-03 23:45:43,107 - Flats. make_pixel_flat - INFO: SXDS2_18545] Bounding top/bottom: 1464/1541 2020-12-03 23:45:43,113 - Flats. make_pixel_flat - INFO: SXDS2_17233] Bounding top/bottom: 1375/1453 2020-12-03 23:45:43,118 - Flats. make_pixel_flat - INFO: SXDS2_19333] Bounding top/bottom: 1199/1365 2020-12-03 23:45:43,129 - Flats. make_pixel_flat - INFO: SXDS2_18880] Bounding top/bottom: 1111/1188 2020-12-03 23:45:43,135 - Flats. make_pixel_flat - INFO: SXDS2_16609] Bounding top/bottom: 976/1100 2020-12-03 23:45:43,143 - Flats. make_pixel_flat - INFO: SXDS2_19221] Bounding top/bottom: 891/968 2020-12-03 23:45:43,152 - Flats. make_pixel_flat - INFO: SXDS2_18406] Bounding top/bottom: 801/880 2020-12-03 23:45:43,161 - Flats. make_pixel_flat - INFO: SXDS2_17265] Bounding top/bottom: 757/791 2020-12-03 23:45:43,165 - Flats. make_pixel_flat - INFO: SXDS2_19838] Bounding top/bottom: 672/749 2020-12-03 23:45:43,171 - Flats. make_pixel_flat - INFO: SXDS2_19791] Bounding top/bottom: 582/662 2020-12-03 23:45:43,176 - Flats. make_pixel_flat - INFO: SXDS2_15659] Bounding top/bottom: 489/570 2020-12-03 23:45:43,183 - Flats. make_pixel_flat - INFO: SXDS2_17094] Bounding top/bottom: 404/482 2020-12-03 23:45:43,189 - Flats. make_pixel_flat - INFO: SXDS2_18415] Bounding top/bottom: 360/394 2020-12-03 23:45:43,193 - Flats. make_pixel_flat - INFO: SXDS2_19510] Bounding top/bottom: 272/350 2020-12-03 23:45:43,198 - Flats. make_pixel_flat - INFO: CALIB_SXDS2_19063] Bounding top/bottom: 184/260 2020-12-03 23:45:43,202 - Flats. make_pixel_flat - INFO: SXDS2_15791] Bounding top/bottom: 92/171 2020-12-03 23:45:43,208 - Flats. make_pixel_flat - INFO: SXDS2_16653] Bounding top/bottom: 5/83 2020-12-03 23:45:43,214 - Flats. make_pixel_flat - INFO: Producing Pixel Flat... 2020-12-03 23:45:44,511 - Flats. make_pixel_flat - INFO: Done. 2020-12-03 23:45:44,517 - Flats. handle_flats - INFO: Pixel flat took 17.62 s


You can see the first file is not loaded.

WIth the modification, the log looks like the following.

2020-12-03 23:50:30,044 - MosfireDrpLog. - INFO: 3.6.3 | packaged by conda-forge | (default, Dec 9 2017, 16:20:51) [GCC 4.2.1 Compatible Apple LLVM 6.1.0 (clang-602.0.53)] 2020-12-03 23:50:30,045 - MosfireDrpLog. - INFO: python version = 3.6.3 2020-12-03 23:50:30,045 - MosfireDrpLog. - INFO: numpy version = 1.13.3 2020-12-03 23:50:30,045 - MosfireDrpLog. - INFO: matplotlib version = 3.1.0 2020-12-03 23:50:30,045 - MosfireDrpLog. - INFO: astropy version = 2.0.3 2020-12-03 23:50:30,045 - MosfireDrpLog. - INFO: ccdproc version = 1.3.0.post1 2020-12-03 23:50:30,174 - IO.list_file_to_strings - DEBUG: Loading: Flat_multi.txt 2020-12-03 23:50:30,175 - Flats. handle_flats - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0036.fits 2020-12-03 23:50:30,175 - Flats. handle_flats - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0037.fits 2020-12-03 23:50:30,175 - Flats. handle_flats - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0038.fits 2020-12-03 23:50:30,175 - Flats. handle_flats - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0039.fits 2020-12-03 23:50:30,175 - Flats. handle_flats - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0040.fits 2020-12-03 23:50:30,175 - Flats. handle_flats - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0041.fits 2020-12-03 23:50:30,175 - Flats. handle_flats - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0042.fits 2020-12-03 23:50:30,175 - Flats. handle_flats - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0043.fits 2020-12-03 23:50:30,175 - Flats. handle_flats - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0044.fits 2020-12-03 23:50:30,175 - Flats. handle_flats - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0045.fits 2020-12-03 23:50:30,175 - Flats. handle_flats - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0046.fits 2020-12-03 23:50:30,175 - Flats. handle_flats - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0047.fits 2020-12-03 23:50:30,175 - Flats. handle_flats - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0048.fits 2020-12-03 23:50:30,197 - IO. readmosfits - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0036.fits contains a DATASEC keyword not compatible with the pipeline 2020-12-03 23:50:30,197 - IO. readmosfits - DEBUG: The content of the keyword will be erased on the reduced data 2020-12-03 23:50:30,275 - IO. readmosfits - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0037.fits contains a DATASEC keyword not compatible with the pipeline 2020-12-03 23:50:30,275 - IO. readmosfits - DEBUG: The content of the keyword will be erased on the reduced data 2020-12-03 23:50:30,354 - IO. readmosfits - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0038.fits contains a DATASEC keyword not compatible with the pipeline 2020-12-03 23:50:30,354 - IO. readmosfits - DEBUG: The content of the keyword will be erased on the reduced data 2020-12-03 23:50:30,432 - IO. readmosfits - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0039.fits contains a DATASEC keyword not compatible with the pipeline 2020-12-03 23:50:30,432 - IO. readmosfits - DEBUG: The content of the keyword will be erased on the reduced data 2020-12-03 23:50:30,508 - IO. readmosfits - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0040.fits contains a DATASEC keyword not compatible with the pipeline 2020-12-03 23:50:30,508 - IO. readmosfits - DEBUG: The content of the keyword will be erased on the reduced data 2020-12-03 23:50:30,587 - IO. readmosfits - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0041.fits contains a DATASEC keyword not compatible with the pipeline 2020-12-03 23:50:30,587 - IO. readmosfits - DEBUG: The content of the keyword will be erased on the reduced data 2020-12-03 23:50:30,669 - IO. readmosfits - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0042.fits contains a DATASEC keyword not compatible with the pipeline 2020-12-03 23:50:30,669 - IO. readmosfits - DEBUG: The content of the keyword will be erased on the reduced data 2020-12-03 23:50:30,750 - IO. readmosfits - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0043.fits contains a DATASEC keyword not compatible with the pipeline 2020-12-03 23:50:30,750 - IO. readmosfits - DEBUG: The content of the keyword will be erased on the reduced data 2020-12-03 23:50:30,826 - IO. readmosfits - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0044.fits contains a DATASEC keyword not compatible with the pipeline 2020-12-03 23:50:30,826 - IO. readmosfits - DEBUG: The content of the keyword will be erased on the reduced data 2020-12-03 23:50:30,900 - IO. readmosfits - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0045.fits contains a DATASEC keyword not compatible with the pipeline 2020-12-03 23:50:30,900 - IO. readmosfits - DEBUG: The content of the keyword will be erased on the reduced data 2020-12-03 23:50:30,979 - IO. readmosfits - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0046.fits contains a DATASEC keyword not compatible with the pipeline 2020-12-03 23:50:30,979 - IO. readmosfits - DEBUG: The content of the keyword will be erased on the reduced data 2020-12-03 23:50:31,059 - IO. readmosfits - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0047.fits contains a DATASEC keyword not compatible with the pipeline 2020-12-03 23:50:31,059 - IO. readmosfits - DEBUG: The content of the keyword will be erased on the reduced data 2020-12-03 23:50:31,142 - IO. readmosfits - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0048.fits contains a DATASEC keyword not compatible with the pipeline 2020-12-03 23:50:31,142 - IO. readmosfits - DEBUG: The content of the keyword will be erased on the reduced data 2020-12-03 23:50:31,203 - Flats. handle_flats - INFO: Attempting to combine files in ['/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0036.fits', '/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0037.fits', '/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0038.fits', '/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0039.fits', '/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0040.fits', '/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0041.fits', '/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0042.fits', '/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0043.fits', '/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0044.fits', '/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0045.fits', '/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0046.fits', '/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0047.fits', '/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0048.fits'] 2020-12-03 23:50:31,203 - IO. imcombine - INFO: Combining files using ccdproc.combine task 2020-12-03 23:50:31,204 - IO. imcombine - INFO: reject=clip_extrema 2020-12-03 23:50:31,204 - IO. imcombine - INFO: nlow=1 2020-12-03 23:50:31,204 - IO. imcombine - INFO: nhigh=1 2020-12-03 23:50:31,204 - IO. imcombine - INFO: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0036.fits 2020-12-03 23:50:31,204 - IO. imcombine - INFO: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0037.fits 2020-12-03 23:50:31,204 - IO. imcombine - INFO: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0038.fits 2020-12-03 23:50:31,204 - IO. imcombine - INFO: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0039.fits 2020-12-03 23:50:31,204 - IO. imcombine - INFO: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0040.fits 2020-12-03 23:50:31,204 - IO. imcombine - INFO: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0041.fits 2020-12-03 23:50:31,204 - IO. imcombine - INFO: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0042.fits 2020-12-03 23:50:31,204 - IO. imcombine - INFO: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0043.fits 2020-12-03 23:50:31,204 - IO. imcombine - INFO: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0044.fits 2020-12-03 23:50:31,205 - IO. imcombine - INFO: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0045.fits 2020-12-03 23:50:31,205 - IO. imcombine - INFO: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0046.fits 2020-12-03 23:50:31,205 - IO. imcombine - INFO: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0047.fits 2020-12-03 23:50:31,205 - IO. imcombine - INFO: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0048.fits 2020-12-03 23:50:36,774 - IO. imcombine - INFO: Done. 2020-12-03 23:50:36,774 - Flats. handle_flats - INFO: *** Attempting to combine Lamps off files in FlatThermal_multi.txt 2020-12-03 23:50:36,774 - IO.list_file_to_strings - DEBUG: Loading: FlatThermal_multi.txt 2020-12-03 23:50:36,775 - Flats. handle_flats - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0049.fits 2020-12-03 23:50:36,775 - Flats. handle_flats - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0050.fits 2020-12-03 23:50:36,775 - Flats. handle_flats - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0051.fits 2020-12-03 23:50:36,775 - Flats. handle_flats - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0052.fits 2020-12-03 23:50:36,775 - Flats. handle_flats - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0053.fits 2020-12-03 23:50:36,775 - Flats. handle_flats - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0054.fits 2020-12-03 23:50:36,775 - Flats. handle_flats - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0055.fits 2020-12-03 23:50:36,775 - Flats. handle_flats - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0056.fits 2020-12-03 23:50:36,775 - Flats. handle_flats - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0057.fits 2020-12-03 23:50:36,775 - Flats. handle_flats - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0058.fits 2020-12-03 23:50:36,775 - Flats. handle_flats - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0059.fits 2020-12-03 23:50:36,775 - Flats. handle_flats - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0060.fits 2020-12-03 23:50:36,775 - Flats. handle_flats - DEBUG: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0061.fits 2020-12-03 23:50:36,775 - IO. imcombine - INFO: Combining files using ccdproc.combine task 2020-12-03 23:50:36,776 - IO. imcombine - INFO: reject=clip_extrema 2020-12-03 23:50:36,776 - IO. imcombine - INFO: nlow=1 2020-12-03 23:50:36,776 - IO. imcombine - INFO: nhigh=1 2020-12-03 23:50:36,776 - IO. imcombine - INFO: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0049.fits 2020-12-03 23:50:36,776 - IO. imcombine - INFO: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0050.fits 2020-12-03 23:50:36,776 - IO. imcombine - INFO: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0051.fits 2020-12-03 23:50:36,776 - IO. imcombine - INFO: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0052.fits 2020-12-03 23:50:36,776 - IO. imcombine - INFO: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0053.fits 2020-12-03 23:50:36,776 - IO. imcombine - INFO: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0054.fits 2020-12-03 23:50:36,776 - IO. imcombine - INFO: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0055.fits 2020-12-03 23:50:36,776 - IO. imcombine - INFO: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0056.fits 2020-12-03 23:50:36,776 - IO. imcombine - INFO: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0057.fits 2020-12-03 23:50:36,776 - IO. imcombine - INFO: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0058.fits 2020-12-03 23:50:36,776 - IO. imcombine - INFO: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0059.fits 2020-12-03 23:50:36,777 - IO. imcombine - INFO: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0060.fits 2020-12-03 23:50:36,777 - IO. imcombine - INFO: /Users/monodera/work/s20b-031/raw/2020nov30/m201130_0061.fits 2020-12-03 23:50:41,605 - IO. imcombine - INFO: Done. 2020-12-03 23:50:41,606 - IO. imarith - INFO: combflat_2d_K.fits - combflat_lamps_off_2d_K.fits -> combflat_lamps_on_2d_K.fits 2020-12-03 23:50:41,795 - Flats. handle_flats - DEBUG: Combined '['/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0036.fits', '/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0037.fits', '/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0038.fits', '/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0039.fits', '/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0040.fits', '/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0041.fits', '/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0042.fits', '/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0043.fits', '/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0044.fits', '/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0045.fits', '/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0046.fits', '/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0047.fits', '/Users/monodera/work/s20b-031/raw/2020nov30/m201130_0048.fits']' to 'SXDS2_19838' 2020-12-03 23:50:41,795 - Flats. handle_flats - DEBUG: Using on-off flat for K band 2020-12-03 23:50:41,822 - IO. readfits - DEBUG: combflat_lamps_on_2d_K.fits contains a DATASEC keyword not compatible with the pipeline 2020-12-03 23:50:41,822 - IO. readfits - DEBUG: The content of the keyword will be erased on the reduced data 2020-12-03 23:50:41,828 - Flats. handle_flats - INFO: Flat written to combflat_lamps_on_2d_K.fits 2020-12-03 23:50:41,828 - Flats. handle_flats - INFO: Finding slit edges in combflat_lamps_on_2d_K.fits 2020-12-03 23:50:41,861 - Flats. find_and_fit_edges - INFO: [00] Finding Slit Edges for SXDS2_19997 ending at 1857. Slit composed of 4 CSU slits 2020-12-03 23:50:41,861 - Flats. find_and_fit_edges - INFO: [00] Threshold used is 8862.7 2020-12-03 23:50:42,092 - Flats. find_and_fit_edges - INFO: [01] Finding Slit Edges for SXDS2_19229 ending at 1680. Slit composed of 4 CSU slits 2020-12-03 23:50:42,092 - Flats. find_and_fit_edges - INFO: [01] Threshold used is 9684.8 2020-12-03 23:50:42,320 - Flats. find_and_fit_edges - INFO: [02] Finding Slit Edges for SXDS2_19981 ending at 1547. Slit composed of 3 CSU slits 2020-12-03 23:50:42,320 - Flats. find_and_fit_edges - INFO: [02] Threshold used is 9436.5 2020-12-03 23:50:42,518 - Flats. find_and_fit_edges - INFO: [03] Finding Slit Edges for SXDS2_18545 ending at 1458. Slit composed of 2 CSU slits 2020-12-03 23:50:42,519 - Flats. find_and_fit_edges - INFO: [03] Threshold used is 8597.2 2020-12-03 23:50:42,745 - Flats. find_and_fit_edges - INFO: [04] Finding Slit Edges for SXDS2_17233 ending at 1370. Slit composed of 2 CSU slits 2020-12-03 23:50:42,745 - Flats. find_and_fit_edges - INFO: [04] Threshold used is 8184.2 2020-12-03 23:50:42,958 - Flats. find_and_fit_edges - INFO: [05] Finding Slit Edges for SXDS2_19333 ending at 1193. Slit composed of 4 CSU slits 2020-12-03 23:50:42,958 - Flats. find_and_fit_edges - INFO: [05] Threshold used is 8901.5 2020-12-03 23:50:43,253 - Flats. find_and_fit_edges - INFO: [06] Finding Slit Edges for SXDS2_18880 ending at 1104. Slit composed of 2 CSU slits 2020-12-03 23:50:43,253 - Flats. find_and_fit_edges - INFO: [06] Threshold used is 8789.0 2020-12-03 23:50:43,464 - Flats. find_and_fit_edges - INFO: [07] Finding Slit Edges for SXDS2_16609 ending at 972. Slit composed of 3 CSU slits 2020-12-03 23:50:43,464 - Flats. find_and_fit_edges - INFO: [07] Threshold used is 7666.4 2020-12-03 23:50:43,714 - Flats. find_and_fit_edges - INFO: [08] Finding Slit Edges for SXDS2_19221 ending at 883. Slit composed of 2 CSU slits 2020-12-03 23:50:43,715 - Flats. find_and_fit_edges - INFO: [08] Threshold used is 8680.4 2020-12-03 23:50:43,948 - Flats. find_and_fit_edges - INFO: [09] Finding Slit Edges for SXDS2_18406 ending at 795. Slit composed of 2 CSU slits 2020-12-03 23:50:43,949 - Flats. find_and_fit_edges - INFO: [09] Threshold used is 8919.2 2020-12-03 23:50:44,191 - Flats. find_and_fit_edges - INFO: [10] Finding Slit Edges for SXDS2_17265 ending at 750. Slit composed of 1 CSU slits 2020-12-03 23:50:44,191 - Flats. find_and_fit_edges - INFO: [10] Threshold used is 8361.7 2020-12-03 23:50:44,480 - Flats. find_and_fit_edges - INFO: [11] Finding Slit Edges for SXDS2_19838 ending at 662. Slit composed of 2 CSU slits 2020-12-03 23:50:44,480 - Flats. find_and_fit_edges - INFO: [11] Threshold used is 8552.5 2020-12-03 23:50:44,620 - Flats. find_edge_pair - INFO: Skipping wavelength pixel): 341 2020-12-03 23:50:45,095 - Flats. find_and_fit_edges - INFO: [12] Finding Slit Edges for SXDS2_19791 ending at 573. Slit composed of 2 CSU slits 2020-12-03 23:50:45,095 - Flats. find_and_fit_edges - INFO: [12] Threshold used is 8458.5 2020-12-03 23:50:45,274 - Flats. find_and_fit_edges - INFO: [13] Finding Slit Edges for SXDS2_15659 ending at 485. Slit composed of 2 CSU slits 2020-12-03 23:50:45,275 - Flats. find_and_fit_edges - INFO: [13] Threshold used is 7013.9 2020-12-03 23:50:45,534 - Flats. find_and_fit_edges - INFO: [14] Finding Slit Edges for SXDS2_17094 ending at 396. Slit composed of 2 CSU slits 2020-12-03 23:50:45,534 - Flats. find_and_fit_edges - INFO: [14] Threshold used is 8198.0 2020-12-03 23:50:45,807 - Flats. find_and_fit_edges - INFO: [15] Finding Slit Edges for SXDS2_18415 ending at 352. Slit composed of 1 CSU slits 2020-12-03 23:50:45,807 - Flats. find_and_fit_edges - INFO: [15] Threshold used is 9098.2 2020-12-03 23:50:46,021 - Flats. find_and_fit_edges - INFO: [16] Finding Slit Edges for SXDS2_19510 ending at 264. Slit composed of 2 CSU slits 2020-12-03 23:50:46,021 - Flats. find_and_fit_edges - INFO: [16] Threshold used is 8306.3 2020-12-03 23:50:46,275 - Flats. find_and_fit_edges - INFO: [17] Finding Slit Edges for CALIB_SXDS2_19063 ending at 175. Slit composed of 2 CSU slits 2020-12-03 23:50:46,275 - Flats. find_and_fit_edges - INFO: [17] Threshold used is 8247.5 2020-12-03 23:50:46,450 - Flats. find_and_fit_edges - INFO: [18] Finding Slit Edges for SXDS2_15791 ending at 87. Slit composed of 2 CSU slits 2020-12-03 23:50:46,450 - Flats. find_and_fit_edges - INFO: [18] Threshold used is 7666.7 2020-12-03 23:50:46,693 - Flats. find_and_fit_edges - INFO: [19] Finding Slit Edges for SXDS2_16653 ending at 1. Slit composed of 2 CSU slits 2020-12-03 23:50:46,694 - Flats. find_and_fit_edges - INFO: [19] Threshold used is 8488.6 2020-12-03 23:50:46,866 - Flats. make_pixel_flat - INFO: SXDS2_19997] Bounding top/bottom: 1862/2034 2020-12-03 23:50:46,878 - Flats. make_pixel_flat - INFO: SXDS2_19229] Bounding top/bottom: 1685/1851 2020-12-03 23:50:46,890 - Flats. make_pixel_flat - INFO: SXDS2_19981] Bounding top/bottom: 1553/1675 2020-12-03 23:50:46,898 - Flats. make_pixel_flat - INFO: SXDS2_18545] Bounding top/bottom: 1464/1541 2020-12-03 23:50:46,904 - Flats. make_pixel_flat - INFO: SXDS2_17233] Bounding top/bottom: 1375/1453 2020-12-03 23:50:46,910 - Flats. make_pixel_flat - INFO: SXDS2_19333] Bounding top/bottom: 1199/1365 2020-12-03 23:50:46,921 - Flats. make_pixel_flat - INFO: SXDS2_18880] Bounding top/bottom: 1111/1188 2020-12-03 23:50:46,928 - Flats. make_pixel_flat - INFO: SXDS2_16609] Bounding top/bottom: 976/1100 2020-12-03 23:50:46,936 - Flats. make_pixel_flat - INFO: SXDS2_19221] Bounding top/bottom: 891/968 2020-12-03 23:50:46,942 - Flats. make_pixel_flat - INFO: SXDS2_18406] Bounding top/bottom: 801/880 2020-12-03 23:50:46,948 - Flats. make_pixel_flat - INFO: SXDS2_17265] Bounding top/bottom: 757/791 2020-12-03 23:50:46,951 - Flats. make_pixel_flat - INFO: SXDS2_19838] Bounding top/bottom: 672/749 2020-12-03 23:50:46,957 - Flats. make_pixel_flat - INFO: SXDS2_19791] Bounding top/bottom: 582/662 2020-12-03 23:50:46,963 - Flats. make_pixel_flat - INFO: SXDS2_15659] Bounding top/bottom: 489/570 2020-12-03 23:50:46,968 - Flats. make_pixel_flat - INFO: SXDS2_17094] Bounding top/bottom: 404/482 2020-12-03 23:50:46,973 - Flats. make_pixel_flat - INFO: SXDS2_18415] Bounding top/bottom: 360/394 2020-12-03 23:50:46,977 - Flats. make_pixel_flat - INFO: SXDS2_19510] Bounding top/bottom: 272/350 2020-12-03 23:50:46,982 - Flats. make_pixel_flat - INFO: CALIB_SXDS2_19063] Bounding top/bottom: 184/260 2020-12-03 23:50:46,986 - Flats. make_pixel_flat - INFO: SXDS2_15791] Bounding top/bottom: 92/171 2020-12-03 23:50:46,992 - Flats. make_pixel_flat - INFO: SXDS2_16653] Bounding top/bottom: 5/83 2020-12-03 23:50:46,997 - Flats. make_pixel_flat - INFO: Producing Pixel Flat... 2020-12-03 23:50:48,271 - Flats. make_pixel_flat - INFO: Done. 2020-12-03 23:50:48,276 - Flats. handle_flats - INFO: Pixel flat took 18.1 s



Here the first file in the lists  are correctly read.

(sorry that my editor automatically did some formatting....)
joshwalawender commented 3 years ago

Thanks @monodera ! I've pointed the PR to the dev branch and we'll do some testing here.