search

njcuk9999 / apero-drs

A PipelinE to Reduce Observations - The DRS for SPIRou (CFHT)
MIT License
12 stars 0 forks source link

Errors with apero_postprocess_spirou.py (0.7.286) #725

Open larnoldgithub opened 10 months ago

larnoldgithub commented 10 months ago

I have many errors like this one. The example below is for an observation of Gl725B. Raw data is fine, 2663172o_pp.fits has QCC_ALL = T with a high SNR on AB but it seems AB A and B have not been extracted for some reason ??? only * _C.fits are in the reduced night directory.

ls -lrt *2663172* gives only -rw-r--r-- 1 spdrs astro 3032640 Sep 2 16:03 2663172o_pp_e2ds_C.fits -rw-r--r-- 1 spdrs astro 3035520 Sep 2 16:03 2663172o_pp_e2dsff_C.fits -rw-r--r-- 1 spdrs astro 49495680 Sep 2 16:03 DEBUG_2663172o_pp_e2dsll_C.fits -rw-r--r-- 1 spdrs astro 11232000 Sep 2 16:03 2663172o_pp_s1d_w_C.fits -rw-r--r-- 1 spdrs astro 10543680 Sep 2 16:03 2663172o_pp_s1d_v_C.fits -rw-r--r-- 1 spdrs astro 3746880 Sep 2 16:04 2663172o_pp_ext_fplines_C.fits

Checking randomly other odometers that failed with the same error, I see that preprocessing ended with QCC_ALL = F for many.

This is what I get when I relaunch the command:

apero_postprocess_spirou.py 21BQ11-Oct16 2663172o_pp.fits --crunfile=run_CCF_POLAR_POSTALL_only.ini --program=POSTALL[88726] --recipe_kind=post-all --shortname=POSTALL --parallel=True 18:44:16.816- |OBJPOST| 18:44:16.822- |OBJPOST| 18:44:16.823- |OBJPOST| SPIROU @PID-00016950626558867468-0NE2 (V0.7.286) 18:44:16.823- |OBJPOST| py3.9.16 git:v0.7.286-stable-test 18:44:16.823- |OBJPOST| 18:44:16.828- |OBJPOST| 18:44:16.834- |OBJPOST| █████╗ ██████╗ ███████╗██████╗ ██████╗
18:44:16.839- |OBJPOST| ██╔══██╗██╔══██╗██╔════╝██╔══██╗██╔═══██╗ 18:44:16.844- |OBJPOST| ███████║██████╔╝█████╗ ██████╔╝██║ ██║ 18:44:16.850- |OBJPOST| ██╔══██║██╔═══╝ ██╔══╝ ██╔══██╗██║ ██║ 18:44:16.855- |OBJPOST| ██║ ██║██║ ███████╗██║ ██║╚██████╔╝ 18:44:16.860- |OBJPOST| ╚═╝ ╚═╝╚═╝ ╚══════╝╚═╝ ╚═╝ ╚═════╝
18:44:16.865- |OBJPOST| * Loading Arguments. Please wait.../apero/apero-drs/apero/core/core/drs_base_classes.py:725: FutureWarning: Calling int on a single element Series is deprecated and will raise a TypeError in the future. Use int(ser.iloc[0]) instead return int(df.iloc[0]) 18:44:17.256-|POSTALL[88726]| DRS Setup: 18:44:17.262-|POSTALL[88726]| 18:44:17.263-|POSTALL[88726]| DRS_ROOT: /apero/apero-drs/apero 18:44:17.263-|POSTALL[88726]| DRS_DATA_RAW: /data/spirou4/arlinks 18:44:17.263-|POSTALL[88726]| DRS_DATA_REDUC: /data/spirou4/apero-data/offline/reduced 18:44:17.263-|POSTALL[88726]| DRS_DATA_WORKING: /data/spirou4/apero-data/offline/tmp 18:44:17.263-|POSTALL[88726]| DRS_CALIB_DB: /data/spirou4/apero-data/offline/calibDB 18:44:17.264-|POSTALL[88726]| DRS_TELLU_DB: /data/spirou4/apero-data/offline/telluDB 18:44:17.264-|POSTALL[88726]| DRS_DATA_ASSETS: /data/spirou4/apero-data/offline/assets 18:44:17.264-|POSTALL[88726]| DRS_DATA_MSG: /data/spirou4/apero-data/offline/msg 18:44:17.264-|POSTALL[88726]| DRS_DATA_RUN: /data/spirou4/apero-data/offline/runs 18:44:17.264-|POSTALL[88726]| DRS_DATA_PLOT: /data/spirou4/apero-data/offline/plot 18:44:17.264-|POSTALL[88726]| DRS_CONFIG: /apero/config/offline/user_config.ini 18:44:17.265-|POSTALL[88726]| DRS_CONFIG: /apero/config/offline/user_constants.ini 18:44:17.265-|POSTALL[88726]| DRS_CONFIG: apero.constants.default.default_config 18:44:17.265-|POSTALL[88726]| DRS_CONFIG: apero.constants.default.default_keywords 18:44:17.265-|POSTALL[88726]| DRS_CONFIG: config.instruments.spirou.default_config.py 18:44:17.265-|POSTALL[88726]| DRS_CONFIG: config.instruments.spirou.default_keywords.py 18:44:17.266-|POSTALL[88726]| DRS_CONFIG: core.instruments.default.default_constants.py 18:44:17.266-|POSTALL[88726]| DRS_CONFIG: core.instruments.spirou.default_constants.py 18:44:17.266-|POSTALL[88726]| DATABASE: MYSQL 18:44:17.266-|POSTALL[88726]| DATABASE-calib: aperooffline@localhost:calib_offline_db 18:44:17.266-|POSTALL[88726]| DATABASE-tellu: aperooffline@localhost:tellu_offline_db 18:44:17.266-|POSTALL[88726]| DATABASE-findex: aperooffline@localhost:findex_offline_db 18:44:17.267-|POSTALL[88726]| DATABASE-log: aperooffline@localhost:log_offline_db 18:44:17.267-|POSTALL[88726]| DATABASE-astrom: aperooffline@localhost:astrom_offline_db 18:44:17.267-|POSTALL[88726]| DATABASE-lang: aperooffline@localhost:lang_offline_db 18:44:17.267-|POSTALL[88726]| DATABASE-reject: aperooffline@localhost:reject_offline_db 18:44:17.267-|POSTALL[88726]| PRINT_LEVEL: all 18:44:17.267-|POSTALL[88726]| LOG_LEVEL: all 18:44:17.268-*|POSTALL[88726]| DRS_PLOT: 0 18:44:17.273- |POSTALL[88726]| 18:44:17.279-|POSTALL[88726]| Arguments used: 18:44:17.285-|POSTALL[88726]| 18:44:17.285-|POSTALL[88726]| --OBS_DIR: /data/spirou4/apero-data/offline/tmp/21BQ11-Oct16 18:44:17.285-|POSTALL[88726]| --FILES[0]: [DRS_PP] 2663172o_pp.fits 18:44:17.285-|POSTALL[88726]| --PROGRAM: POSTALL[88726] 18:44:17.286-|POSTALL[88726]| --RECIPE_KIND: post-all 18:44:17.286-|POSTALL[88726]| --PARALLEL: True 18:44:17.286-|POSTALL[88726]| --SHORTNAME: POSTALL 18:44:17.286-|POSTALL[88726]| --CRUNFILE: run_CCF_POLAR_POSTALL_only.ini 18:44:17.292- |POSTALL[88726]| 18:44:19.380-|POSTALL[88726]| 18:44:19.399-|POSTALL[88726]| Processing DRS_POST_E 18:44:19.411-|POSTALL[88726]| * 18:44:19.428- |POSTALL[88726]| Loading full database. OBS_DIR=21BQ11-Oct16. Please wait... 18:44:25.564- |POSTALL[88726]| Full database loaded in 6.1252 s 18:44:25.584- |POSTALL[88726]| Adding EXT=0 (PP) [Header only] mode=primary 18:44:25.604- |POSTALL[88726]| File: 2663172o_pp.fits 18:44:25.910-@$|POSTALL[88726]| W[00-090-00005]: No entries found for extension 1 (EXT_AB) 18:44:25.911-@$|POSTALL[88726]| Condition = KW_IDENTIFIER="2663172o" AND BLOCK_KIND="red" AND 18:44:25.911-@$|POSTALL[88726]| KW_OUTPUT="EXT_E2DS_FF" AND KW_FIBER="AB" 18:44:25.911-@$|POSTALL[88726]| Function = drs_file.py.DrsInputFile.process_links() 18:44:25.955-*|POSTALL[88726]| 18:44:25.966-|POSTALL[88726]| Processing DRS_POST_S 18:44:25.976-|POSTALL[88726]| * 18:44:26.009- |POSTALL[88726]| Loading full database. OBS_DIR=21BQ11-Oct16. Please wait... 18:44:31.901- |POSTALL[88726]| Full database loaded in 5.8808 s 18:44:31.921- |POSTALL[88726]| Adding EXT=0 (PP) [Header only] mode=primary 18:44:31.943- |POSTALL[88726]| File: 2663172o_pp.fits 18:44:32.083- |POSTALL[88726]| Adding EXT-1 (S1D_W) [TABLE] mode=science 18:44:32.402-@$|POSTALL[88726]| W[00-090-00007]: Column file for EXT=1 (S1D_W) not found. 18:44:32.403-@$|POSTALL[88726]| Condition = KW_IDENTIFIER="2663172o" AND BLOCK_KIND="red" AND 18:44:32.403-@$|POSTALL[88726]| KW_OUTPUT="EXT_S1D_W" AND KW_FIBER="AB" 18:44:32.403-@$|POSTALL[88726]| Function = drs_file.py.DrsOutFileExtension.make_table() 18:44:32.456-*|POSTALL[88726]| 18:44:32.467-|POSTALL[88726]| Processing DRS_POST_T 18:44:32.478-|POSTALL[88726]| * 18:44:32.495- |POSTALL[88726]| Loading full database. OBS_DIR=21BQ11-Oct16. Please wait... 18:44:38.505- |POSTALL[88726]| Full database loaded in 5.9997 s 18:44:38.525- |POSTALL[88726]| Adding EXT=0 (PP) [Header only] mode=primary 18:44:38.545- |POSTALL[88726]| File: 2663172o_pp.fits 18:44:38.853-@$|POSTALL[88726]| W[10-090-00003]: File not found for ext 1 (TELLU_AB) 18:44:38.872-*|POSTALL[88726]| 18:44:38.905-|POSTALL[88726]| Processing DRS_POST_V 18:44:38.926-|POSTALL[88726]| * 18:44:38.949- |POSTALL[88726]| Loading full database. OBS_DIR=21BQ11-Oct16. Please wait... 18:44:44.969- |POSTALL[88726]| Full database loaded in 6.0022 s 18:44:44.993- |POSTALL[88726]| Adding EXT=0 (PP) [Header only] mode=primary 18:44:45.004- |POSTALL[88726]| File: 2663172o_pp.fits 18:44:45.319-@$|POSTALL[88726]| W[10-090-00003]: File not found for ext 1 (VEL) 18:44:45.347-*|POSTALL[88726]| 18:44:45.359-|POSTALL[88726]| Processing DRS_POST_P 18:44:45.370-|POSTALL[88726]| 18:44:45.395- |POSTALL[88726]| Loading full database. OBS_DIR=21BQ11-Oct16. Please wait... 18:44:51.437- |POSTALL[88726]| Full database loaded in 6.0311 s 18:44:51.457- |POSTALL[88726]| Adding EXT=0 (PP) [Header only] mode=primary 18:44:51.477- |POSTALL[88726]| File: 2663172o_pp.fits 18:44:51.802-@$|POSTALL[88726]| W[10-090-00003]: File not found for ext 1 (POL) 18:44:51.861- |POSTALL[88726]| 18:44:51.881-!!|POSTALL[88726]| E[00-090-00005]: No entries found for extension 1 (EXT_AB) 18:44:51.882-!!|POSTALL[88726]| Condition = KW_IDENTIFIER="2663172o" AND BLOCK_KIND="red" AND 18:44:51.882-!!|POSTALL[88726]| KW_OUTPUT="EXT_E2DS_FF" AND KW_FIBER="AB" 18:44:51.882-!!|POSTALL[88726]| Function = drs_file.py.DrsInputFile.process_links() 18:44:51.913- |POSTALL[88726]| 18:44:51.924-!!|POSTALL[88726]| E[00-090-00007]: Column file for EXT=1 (S1D_W) not found. 18:44:51.924-!!|POSTALL[88726]| Condition = KW_IDENTIFIER="2663172o" AND BLOCK_KIND="red" AND 18:44:51.924-!!|POSTALL[88726]| KW_OUTPUT="EXT_S1D_W" AND KW_FIBER="AB" 18:44:51.924-!!|POSTALL[88726]| Function = drs_file.py.DrsOutFileExtension.make_table() 18:44:51.946- |POSTALL[88726]| 18:44:51.957-!!|POSTALL[88726]| E[00-090-00010]: 2 error(s) occurred for apero_postprocess_spirou 18:44:52.128-|POSTALL[88726]| 18:44:52.140-@!|POSTALL[88726]| W[40-003-00005]: Recipe apero_postprocess_spirou has NOT been successfully 18:44:52.140-@!|POSTALL[88726]| completed 18:44:52.151-|POSTALL[88726]|

njcuk9999 commented 10 months ago

If preprocessed passed then something went wrong with the extraction code, you'd need to find the extraction code log and look for an error.

larnoldgithub commented 10 months ago

I've found that the extraction failed because of mysql timeout. I thought I had reprocessed all files that had this issue 2week ago, but it seems I didn't catch them all. here is the log file of the extraction for that odometer: 02:02:04.781- |EXTALL[26743]| 02:02:04.805- |EXTALL[26743]| 02:02:04.824- |EXTALL[26743]| SPIROU @PID-00016937065235734798-80DG (V0.7.286) 02:02:04.865- |EXTALL[26743]| py3.9.16 git:v0.7.286-stable-test 02:02:04.882- |EXTALL[26743]| 02:02:04.914- |EXTALL[26743]| Group: APEROG-PID-00016934391638252470-QNB4_apero_processing_group 02:02:04.931- |EXTALL[26743]| *** 02:02:04.993-|EXTALL[26743]|I[40-001-00006]: DRS Setup: 02:02:05.010-|EXTALL[26743]|I[ 02:02:05.051-|EXTALL[26743]| DRS_ROOT: /apero/apero-drs/apero]: 02:02:05.083-|EXTALL[26743]| DRS_ROOT: /apero/apero-drs/apero 02:02:05.117-|EXTALL[26743]| DRS_DATA_RAW: /data/spirou4/arlinks 02:02:05.150-|EXTALL[26743]| DRS_DATA_REDUC: /data/spirou4/apero-data/offline/reduced 02:02:05.193-|EXTALL[26743]| DRS_DATA_WORKING: /data/spirou4/apero-data/offline/tmp 02:02:05.235-|EXTALL[26743]| DRS_CALIB_DB: /data/spirou4/apero-data/offline/calibDB 02:02:05.267-|EXTALL[26743]| DRS_TELLU_DB: /data/spirou4/apero-data/offline/telluDB 02:02:05.309-|EXTALL[26743]| DRS_DATA_ASSETS: /data/spirou4/apero-data/offline/assets 02:02:05.335-|EXTALL[26743]| DRS_DATA_MSG: /data/spirou4/apero-data/offline/msg 02:02:05.376-|EXTALL[26743]| DRS_DATA_RUN: /data/spirou4/apero-data/offline/runs 02:02:05.410-|EXTALL[26743]| DRS_DATA_PLOT: /data/spirou4/apero-data/offline/plot 02:02:05.418-|EXTALL[26743]| DRS_CONFIG: /apero/config/offline/user_config.ini 02:02:05.451-|EXTALL[26743]| DRS_CONFIG: /apero/config/offline/user_constants.ini 02:02:05.535-|EXTALL[26743]| DRS_CONFIG: apero.constants.default.default_config 02:02:05.610-|EXTALL[26743]| DRS_CONFIG: apero.constants.default.default_keywords 02:02:05.677-|EXTALL[26743]| DRS_CONFIG: config.instruments.spirou.default_config.py 02:02:05.743-|EXTALL[26743]| DRS_CONFIG: config.instruments.spirou.default_keywords.py 02:02:05.850-|EXTALL[26743]| DRS_CONFIG: core.instruments.default.default_constants.py 02:02:05.885-|EXTALL[26743]| DRS_CONFIG: core.instruments.spirou.default_constants.py 02:02:05.911-|EXTALL[26743]| DATABASE: MYSQL 02:02:05.986-|EXTALL[26743]| DATABASE-calib: aperooffline@localhost:calib_offline_db 02:02:06.012-|EXTALL[26743]| DATABASE-tellu: aperooffline@localhost:tellu_offline_db 02:02:06.037-|EXTALL[26743]| DATABASE-findex: aperooffline@localhost:findex_offline_db 02:02:06.071-|EXTALL[26743]| DATABASE-log: aperooffline@localhost:log_offline_db 02:02:06.105-|EXTALL[26743]| DATABASE-astrom: aperooffline@localhost:astrom_offline_db 02:02:06.139-|EXTALL[26743]| DATABASE-lang: aperooffline@localhost:lang_offline_db 02:02:06.172-|EXTALL[26743]| DATABASE-reject: aperooffline@localhost:reject_offline_db 02:02:06.197-|EXTALL[26743]| PRINT_LEVEL: all 02:02:06.222-|EXTALL[26743]| LOG_LEVEL: all 02:02:06.257-|EXTALL[26743]| DRS_PLOT: 0 02:02:06.288- |EXTALL[26743]| * 02:02:06.324- |EXTALL[26743]|A[40-001-00010]: System information 02:02:06.357- |EXTALL[26743]| 02:02:06.403- |EXTALL[26743]| Python version = '3.9.16' 02:02:06.458- |EXTALL[26743]| Distribution date = 'main, Jan 11 2023, 16:05:54' 02:02:06.483- |EXTALL[26743]| Other information = 'GCC 11.2.0' 02:02:06.542- |EXTALL[26743]| Path = '/conda/miniconda3/envs/apero-env/bin/python' 02:02:06.624- |EXTALL[26743]| Platform = 'linux' 02:02:06.692- |EXTALL[26743]| Currently installed python modules: 02:02:06.768- |EXTALL[26743]| astropy: 5.3 (req: 5.3) 02:02:06.844- |EXTALL[26743]| astroquery: 0.4.6 (req: 0.4.6) 02:02:06.886- |EXTALL[26743]| barycorrpy: 0.4.4 (req: 0.4.4) 02:02:06.978- |EXTALL[26743]| duckdb: 0.8.0 (req: 0.8) 02:02:07.058- |EXTALL[26743]| matplotlib: 3.7.1 (req: 3.7.1) 02:02:07.125- |EXTALL[26743]| numba: 0.57.0 (req: 0.57.0) 02:02:07.200- |EXTALL[26743]| numexpr: 2.8.4 (req: 2.8.4) 02:02:07.284- |EXTALL[26743]| numpy: 1.24.3 (req: 1.24.3) 02:02:07.360- |EXTALL[26743]| pandas: 2.0.1 (req: 2.0.1) 02:02:07.435- |EXTALL[26743]| pandastable: 0.13.1 (req: 0.13.1) 02:02:07.527- |EXTALL[26743]| psutil: 5.9.4 (req: 5.9.4) 02:02:07.561- |EXTALL[26743]| scipy: 1.9.2 (req: 1.9.2) 02:02:07.636- |EXTALL[26743]| tqdm: 4.65.0 (req: 4.65.0) 02:02:07.712- |EXTALL[26743]| yagmail: 0.15.293 (req: 0.15.293) 02:02:07.787- |EXTALL[26743]| Raw arguments used: 02:02:07.829- |EXTALL[26743]| Arg 1 = 'apero_processing.py' 02:02:07.896- |EXTALL[26743]| 02:02:07.970-|EXTALL[26743]|I[40-001-00017]: Arguments used: 02:02:08.053-|EXTALL[26743]| 02:02:08.138-|EXTALL[26743]| --OBS_DIR: /data/spirou4/apero-data/offline/tmp/21BQ11-Oct16 02:02:08.217-|EXTALL[26743]| --FILES[0]: [DRS_PP] 2663172o_pp.fits 02:02:08.297-|EXTALL[26743]| --QUICKLOOK: False 02:02:08.372-|EXTALL[26743]| --BADCORR: True 02:02:08.439-|EXTALL[26743]| --BACKSUB: True 02:02:08.514-|EXTALL[26743]| --COMBINE: False 02:02:08.590-|EXTALL[26743]| --COMBINE_METHOD: sum 02:02:08.664-|EXTALL[26743]| --OBJNAME: None 02:02:08.713-|EXTALL[26743]| --DPRTYPE: None 02:02:08.760-|EXTALL[26743]| --DARKCORR: True 02:02:08.805-|EXTALL[26743]| --FIBER: ALL 02:02:08.874-|EXTALL[26743]| --FLIPIMAGE: both 02:02:08.931-|EXTALL[26743]| --FLUXUNITS: e- 02:02:08.966-|EXTALL[26743]| --PLOT: 0 02:02:09.032-|EXTALL[26743]| --RESIZE: True 02:02:09.099-|EXTALL[26743]| --LEAKCORR: True 02:02:09.121-|EXTALL[26743]| --THERMAL: True 02:02:09.149-|EXTALL[26743]| --FORCE_REF_WAVE: False 02:02:09.192-|EXTALL[26743]| --DEBUG: None 02:02:09.262-|EXTALL[26743]| --PROGRAM: EXTALL[26743] 02:02:09.289-|EXTALL[26743]| --RECIPE_KIND: extract-ALL 02:02:09.330-|EXTALL[26743]| --PARALLEL: True 02:02:09.356-|EXTALL[26743]| --SHORTNAME: EXTALL 02:02:09.406-|EXTALL[26743]| --IDEBUG: None 02:02:09.456-|EXTALL[26743]| --REF: None 02:02:09.482-|EXTALL[26743]| --CRUNFILE: run_EXTALL_only.ini 02:02:09.531-|EXTALL[26743]| --NOSAVE: False 02:02:09.557-|EXTALL[26743]| --FORCE_INDIR: None 02:02:09.585-|EXTALL[26743]| --FORCE_OUTDIR: None 02:02:09.682- |EXTALL[26743]| ** 02:02:09.828- |EXTALL[26743]|A[40-005-10004]: Checking input qc for: files 02:02:09.890- |EXTALL[26743]|A[40-005-10005]: All input files files passed QC 02:02:10.085- |EXTALL[26743]| 02:02:10.179- |EXTALL[26743]|A[40-001-00020]: Processing file 1 of 1 02:02:10.250- |EXTALL[26743]| * 02:02:10.378-|EXTALL[26743]|I[40-016-00032]: File identified as POLAR_FP (OBJ=GL725B) 02:02:10.618- |EXTALL[26743]|A[40-014-00031]: Reading shape dxmap file: /data/spirou4/apero-data/offline/calibDB/3444961B5D_pp_shapex.fits 02:02:10.890- |EXTALL[26743]|A[40-014-00032]: Reading shape dymap file: /data/spirou4/apero-data/offline/calibDB/3444961B5D_pp_shapey.fits 02:02:11.039- |EXTALL[26743]|A[40-005-10003]: Calibration SHAPEL within delta time threshold (0.11288636732206214<7.0 days) 02:02:11.191- |EXTALL[26743]| File: /data/spirou4/apero-data/offline/calibDB/722475D7D7_pp_shapel.fits 02:02:11.331- |EXTALL[26743]|A[40-014-00039]: Reading night shape file: /data/spirou4/apero-data/offline/calibDB/722475D7D7_pp_shapel.fits 02:02:16.948-|EXTALL[26743]|I[40-014-00038]: Calibrating file: /data/spirou4/apero-data/offline/tmp/21BQ11-Oct16/2663172o_pp.fits 02:02:17.423- |EXTALL[26743]|A[40-011-00011]: Doing dark correction using DARK_FILE: /data/spirou4/apero-data/offline/calibDB/2886655d_pp_dark_ref.fits 02:02:18.063- |EXTALL[26743]|A[40-014-00013]: Image POLAR_FP resized from (4096, 4096) to (3100, 4088) 02:02:18.172- |EXTALL[26743]|A[40-005-10003]: Calibration BADPIX within delta time threshold (0.09872690001066076<7.0 days) 02:02:18.188- |EXTALL[26743]| File: /data/spirou4/apero-data/offline/calibDB/06CA46428B_pp_badpixel.fits 02:02:18.343- |EXTALL[26743]|A[40-012-00008]: Correcting for bad pixels (setting bad pixels to NaN) 02:02:18.356- |EXTALL[26743]| file = /data/spirou4/apero-data/offline/calibDB/06CA46428B_pp_badpixel.fits 02:02:18.502- |EXTALL[26743]|A[40-005-10003]: Calibration BKGRDMAP within delta time threshold (0.09872690001066076<7.0 days) 02:02:18.515- |EXTALL[26743]| File: /data/spirou4/apero-data/offline/calibDB/06CA46428B_pp_bmap.fits 02:02:18.542- |EXTALL[26743]|A[40-012-00010]: Measuring local background using 2D Gaussian Kernel 02:02:21.820- |EXTALL[26743]|A[40-012-00009]: Correcting for global background using file = /data/spirou4/apero-data/offline/calibDB/06CA46428B_pp_bmap.fits 02:02:26.603- |EXTALL[26743]|Background Iteration 0: delta background rms=7.799 02:02:30.657- |EXTALL[26743]|Background Iteration 1: delta background rms=1.248 02:02:33.899- |EXTALL[26743]|Background Iteration 2: delta background rms=0.551 02:02:38.307- |EXTALL[26743]|Background Iteration 3: delta background rms=0.401 02:02:42.573- |EXTALL[26743]|Background Iteration 4: delta background rms=0.338 02:02:44.490- |EXTALL[26743]|A[40-014-00012]: Cleaning FP hot pixels 02:02:44.593- |EXTALL[26743]|A[40-005-10003]: Calibration BADPIX within delta time threshold (0.09872690001066076<7.0 days) 02:02:44.600- |EXTALL[26743]| File: /data/spirou4/apero-data/offline/calibDB/06CA46428B_pp_badpixel.fits 02:02:51.459-|EXTALL[26743]|I[40-016-00003]: Straightening Order Profile fiber = C 02:02:54.634- |EXTALL[26743]|A[40-013-00023]: Reading order profile from npy file /data/spirou4/apero-data/offline/reduced/21BQ11-Oct16/722475D7D7_pp_shapel_orderps_C.fits 02:02:54.726-|EXTALL[26743]|I[40-016-00003]: Straightening Order Profile fiber = AB 02:03:08.012- |EXTALL[26743]|A[40-013-00023]: Reading order profile from npy file /data/spirou4/apero-data/offline/reduced/21BQ11-Oct16/722475D7D7_pp_shapel_orderps_AB.fits 02:03:08.105-|EXTALL[26743]|I[40-016-00003]: Straightening Order Profile fiber = A 02:03:19.243- |EXTALL[26743]|A[40-013-00023]: Reading order profile from npy file /data/spirou4/apero-data/offline/reduced/21BQ11-Oct16/722475D7D7_pp_shapel_orderps_A.fits 02:03:19.309-|EXTALL[26743]|I[40-016-00003]: Straightening Order Profile fiber = B 02:03:28.454- |EXTALL[26743]|A[40-013-00023]: Reading order profile from npy file /data/spirou4/apero-data/offline/reduced/21BQ11-Oct16/722475D7D7_pp_shapel_orderps_B.fits 02:03:28.531-|EXTALL[26743]|I[40-016-00004]: Straightening Image 02:03:28.544- |EXTALL[26743]|A[40-014-00041]: Transforming (dxmap=1, dymap=1, trans=1) 02:03:32.015-|EXTALL[26743]|I[40-016-00017]: Calculating Barycentric Corrections 02:03:33.553- |EXTALL[26743]|A[40-016-00035]: Identified object as GL725B with BERV = -4.4008 km/s 02:03:33.647-|EXTALL[26743]|I[40-016-00014]: Processing fiber C of [C, AB, A, B] 02:03:33.771- |EXTALL[26743]|A[40-005-10003]: Calibration WAVE within delta time threshold (0.11288636732206214<7.0 days) 02:03:33.778- |EXTALL[26743]| File: /data/spirou4/apero-data/offline/calibDB/722475D7D7_pp_e2dsff_C_wave_night_C.fits 02:03:33.842- |EXTALL[26743]|A[40-017-00036]: Wavelength solution read from calibDB[night]. 02:03:33.854- |EXTALL[26743]| Wave file = /data/spirou4/apero-data/offline/calibDB/722475D7D7_pp_e2dsff_C_wave_night_C.fits 02:03:33.985- |EXTALL[26743]|A[40-005-10003]: Calibration LOC within delta time threshold (0.08905089001200395<7.0 days) 02:03:33.995- |EXTALL[26743]| File: /data/spirou4/apero-data/offline/calibDB/AE338F566E_pp_loco_C.fits 02:03:34.149- |EXTALL[26743]|A[40-005-10003]: Calibration FLAT within delta time threshold (0.09388909667904954<7.0 days) 02:03:34.161- |EXTALL[26743]| File: /data/spirou4/apero-data/offline/calibDB/AE49ECE09E_pp_flat_C.fits 02:03:34.199- |EXTALL[26743]|A[40-015-00006]: Reading flat dymap file: /data/spirou4/apero-data/offline/calibDB/AE49ECE09E_pp_flat_C.fits 02:03:34.296- |EXTALL[26743]|A[40-005-10003]: Calibration BLAZE within delta time threshold (0.09388909667904954<7.0 days) 02:03:34.307- |EXTALL[26743]| File: /data/spirou4/apero-data/offline/calibDB/AE49ECE09E_pp_blaze_C.fits 02:03:34.328- |EXTALL[26743]|A[40-015-00007]: Reading blaze dymap file: /data/spirou4/apero-data/offline/calibDB/AE49ECE09E_pp_blaze_C.fits 02:03:34.367-|EXTALL[26743]|I[40-016-00011]: Extracting straightened image 02:03:34.548- |EXTALL[26743]|A[40-016-00001]: On fiber C order 0: S/N= 18.0 Nbcosmic= 16212 02:03:34.711- |EXTALL[26743]|A[40-016-00001]: On fiber C order 1: S/N= 20.6 Nbcosmic= 8296 02:03:34.857- |EXTALL[26743]|A[40-016-00001]: On fiber C order 2: S/N= 23.9 Nbcosmic= 1956 02:03:35.003- |EXTALL[26743]|A[40-016-00001]: On fiber C order 3: S/N= 26.3 Nbcosmic= 137 02:03:35.156- |EXTALL[26743]|A[40-016-00001]: On fiber C order 4: S/N= 29.5 Nbcosmic= 137 02:03:35.359- |EXTALL[26743]|A[40-016-00001]: On fiber C order 5: S/N= 32.4 Nbcosmic= 122 02:03:35.523- |EXTALL[26743]|A[40-016-00001]: On fiber C order 6: S/N= 35.0 Nbcosmic= 122 02:03:35.688- |EXTALL[26743]|A[40-016-00001]: On fiber C order 7: S/N= 37.6 Nbcosmic= 141 02:03:35.930- |EXTALL[26743]|A[40-016-00001]: On fiber C order 8: S/N= 40.6 Nbcosmic= 117 02:03:36.215- |EXTALL[26743]|A[40-016-00001]: On fiber C order 9: S/N= 42.2 Nbcosmic= 281 02:03:36.473- |EXTALL[26743]|A[40-016-00001]: On fiber C order 10: S/N= 44.0 Nbcosmic= 323 02:03:36.771- |EXTALL[26743]|A[40-016-00001]: On fiber C order 11: S/N= 45.2 Nbcosmic= 266 02:03:37.005- |EXTALL[26743]|A[40-016-00001]: On fiber C order 12: S/N= 47.8 Nbcosmic= 156 02:03:37.166- |EXTALL[26743]|A[40-016-00001]: On fiber C order 13: S/N= 49.2 Nbcosmic= 127 02:03:37.412- |EXTALL[26743]|A[40-016-00001]: On fiber C order 14: S/N= 51.4 Nbcosmic= 128 02:03:37.740- |EXTALL[26743]|A[40-016-00001]: On fiber C order 15: S/N= 54.7 Nbcosmic= 133 02:03:38.072- |EXTALL[26743]|A[40-016-00001]: On fiber C order 16: S/N= 57.4 Nbcosmic= 116 02:03:38.344- |EXTALL[26743]|A[40-016-00001]: On fiber C order 17: S/N= 59.7 Nbcosmic= 103 02:03:38.594- |EXTALL[26743]|A[40-016-00001]: On fiber C order 18: S/N= 62.3 Nbcosmic= 117 02:03:38.842- |EXTALL[26743]|A[40-016-00001]: On fiber C order 19: S/N= 65.2 Nbcosmic= 122 02:03:39.096- |EXTALL[26743]|A[40-016-00001]: On fiber C order 20: S/N= 67.2 Nbcosmic= 128 02:03:39.347- |EXTALL[26743]|A[40-016-00001]: On fiber C order 21: S/N= 70.5 Nbcosmic= 160 02:03:39.606- |EXTALL[26743]|A[40-016-00001]: On fiber C order 22: S/N= 71.3 Nbcosmic= 107 02:03:39.864- |EXTALL[26743]|A[40-016-00001]: On fiber C order 23: S/N= 68.3 Nbcosmic= 716 02:03:40.097- |EXTALL[26743]|A[40-016-00001]: On fiber C order 24: S/N= 63.3 Nbcosmic= 131 02:03:40.349- |EXTALL[26743]|A[40-016-00001]: On fiber C order 25: S/N= 79.2 Nbcosmic= 780 02:03:40.563- |EXTALL[26743]|A[40-016-00001]: On fiber C order 26: S/N= 87.1 Nbcosmic= 169 02:03:40.733- |EXTALL[26743]|A[40-016-00001]: On fiber C order 27: S/N= 92.8 Nbcosmic= 150 02:03:40.893- |EXTALL[26743]|A[40-016-00001]: On fiber C order 28: S/N= 95.1 Nbcosmic= 145 02:03:41.129- |EXTALL[26743]|A[40-016-00001]: On fiber C order 29: S/N= 96.6 Nbcosmic= 127 02:03:41.439- |EXTALL[26743]|A[40-016-00001]: On fiber C order 30: S/N= 100.9 Nbcosmic= 156 02:03:41.750- |EXTALL[26743]|A[40-016-00001]: On fiber C order 31: S/N= 104.7 Nbcosmic= 131 02:03:42.051- |EXTALL[26743]|A[40-016-00001]: On fiber C order 32: S/N= 107.1 Nbcosmic= 124 02:03:42.352- |EXTALL[26743]|A[40-016-00001]: On fiber C order 33: S/N= 106.9 Nbcosmic= 110 02:03:42.515- |EXTALL[26743]|A[40-016-00001]: On fiber C order 34: S/N= 108.8 Nbcosmic= 110 02:03:42.679- |EXTALL[26743]|A[40-016-00001]: On fiber C order 35: S/N= 110.5 Nbcosmic= 170 02:03:42.860- |EXTALL[26743]|A[40-016-00001]: On fiber C order 36: S/N= 113.1 Nbcosmic= 99 02:03:43.017- |EXTALL[26743]|A[40-016-00001]: On fiber C order 37: S/N= 112.8 Nbcosmic= 116 02:03:43.211- |EXTALL[26743]|A[40-016-00001]: On fiber C order 38: S/N= 111.2 Nbcosmic= 142 02:03:43.376- |EXTALL[26743]|A[40-016-00001]: On fiber C order 39: S/N= 109.5 Nbcosmic= 133 02:03:43.614- |EXTALL[26743]|A[40-016-00001]: On fiber C order 40: S/N= 112.1 Nbcosmic= 137 02:03:43.761- |EXTALL[26743]|A[40-016-00001]: On fiber C order 41: S/N= 114.0 Nbcosmic= 111 02:03:43.944- |EXTALL[26743]|A[40-016-00001]: On fiber C order 42: S/N= 113.4 Nbcosmic= 118 02:03:44.091- |EXTALL[26743]|A[40-016-00001]: On fiber C order 43: S/N= 108.6 Nbcosmic= 138 02:03:44.247- |EXTALL[26743]|A[40-016-00001]: On fiber C order 44: S/N= 49.4 Nbcosmic= 217 02:03:44.449- |EXTALL[26743]|A[40-016-00001]: On fiber C order 45: S/N= 40.7 Nbcosmic= 116 02:03:44.602- |EXTALL[26743]|A[40-016-00001]: On fiber C order 46: S/N= 71.9 Nbcosmic= 138 02:03:44.758- |EXTALL[26743]|A[40-016-00001]: On fiber C order 47: S/N= 61.7 Nbcosmic= 122 02:03:44.961- |EXTALL[26743]|A[40-016-00001]: On fiber C order 48: S/N= 29.1 Nbcosmic= 104 02:03:45.001-|EXTALL[26743]|I[40-016-00034]: Not correcting FP leakage: FIBER=C REF_E2DS=None 02:03:45.226- |EXTALL[26743]|A[40-017-00036]: Wavelength solution read from reference. 02:03:45.248- |EXTALL[26743]| Wave file = /data/spirou4/apero-data/offline/calibDB/3444961B5D_pp_e2dsff_C_wavesol_ref_C.fits 02:03:45.376- |EXTALL[26743]|A[40-005-10003]: Calibration THERMALI within delta time threshold (0.06476642037887359<7.0 days) 02:03:45.384- |EXTALL[26743]| File: /data/spirou4/apero-data/offline/calibDB/8E9126B697_pp_thermal_e2ds_int_C.fits 02:03:45.418- |EXTALL[26743]|A[40-016-00027]: Reading thermal file: /data/spirou4/apero-data/offline/calibDB/8E9126B697_pp_thermal_e2ds_int_C.fits 02:03:45.438-|EXTALL[26743]|I[40-016-00012]: Correcting thermal for fiber type = FP (mode=1) 02:03:46.897- |EXTALL[26743]|A[40-016-00009]: Calculating S1D (wave) 02:03:47.382- |EXTALL[26743]|A[40-016-00009]: Calculating S1D (velocity) 02:03:47.983-|EXTALL[26743]|I[40-005-10001]: QUALITY CONTROL SUCCESSFUL - Well Done - 02:03:48.316- |EXTALL[26743]|A[40-016-00005]: Saving E2DS file: /data/spirou4/apero-data/offline/reduced/21BQ11-Oct16/2663172o_pp_e2ds_C.fits 02:03:48.889- |EXTALL[26743]|A[40-016-00006]: Saving E2DSFF file: /data/spirou4/apero-data/offline/reduced/21BQ11-Oct16/2663172o_pp_e2dsff_C.fits 02:03:49.406- |EXTALL[26743]|A[40-016-00007]: Saving E2DSLL file: /data/spirou4/apero-data/offline/reduced/21BQ11-Oct16/DEBUG_2663172o_pp_e2dsll_C.fits 02:03:50.047- |EXTALL[26743]|A[40-016-00010]: Saving S1D (wave) file: /data/spirou4/apero-data/offline/reduced/21BQ11-Oct16/2663172o_pp_s1d_w_C.fits 02:03:50.667- |EXTALL[26743]|A[40-016-00010]: Saving S1D (velocity) file: /data/spirou4/apero-data/offline/reduced/21BQ11-Oct16/2663172o_pp_s1d_v_C.fits 02:03:51.028- |EXTALL[26743]|A[40-017-00040]: Loading reference wave HC/FP line files 02:03:51.290-|EXTALL[26743]|I[40-017-00062]: Getting reference lines from inputs for FP (iteration = 0) 02:03:52.644- |EXTALL[26743]|A[40-017-00051]: Order 0/48 Fiber C Valid lines: 548/782 (type=FP) 02:03:54.299- |EXTALL[26743]|A[40-017-00051]: Order 1/48 Fiber C Valid lines: 631/771 (type=FP) 02:03:56.273- |EXTALL[26743]|A[40-017-00051]: Order 2/48 Fiber C Valid lines: 705/762 (type=FP) 02:03:58.296- |EXTALL[26743]|A[40-017-00051]: Order 3/48 Fiber C Valid lines: 711/751 (type=FP) 02:04:00.178- |EXTALL[26743]|A[40-017-00051]: Order 4/48 Fiber C Valid lines: 710/741 (type=FP) 02:04:01.684- |EXTALL[26743]|A[40-017-00051]: Order 5/48 Fiber C Valid lines: 697/730 (type=FP) 02:04:02.966- |EXTALL[26743]|A[40-017-00051]: Order 6/48 Fiber C Valid lines: 688/721 (type=FP) 02:04:04.077- |EXTALL[26743]|A[40-017-00051]: Order 7/48 Fiber C Valid lines: 692/711 (type=FP) 02:04:05.098- |EXTALL[26743]|A[40-017-00051]: Order 8/48 Fiber C Valid lines: 685/701 (type=FP) 02:04:06.119- |EXTALL[26743]|A[40-017-00051]: Order 9/48 Fiber C Valid lines: 675/691 (type=FP) 02:04:07.031- |EXTALL[26743]|A[40-017-00051]: Order 10/48 Fiber C Valid lines: 673/681 (type=FP) 02:04:07.871- |EXTALL[26743]|A[40-017-00051]: Order 11/48 Fiber C Valid lines: 662/671 (type=FP) 02:04:08.951- |EXTALL[26743]|A[40-017-00051]: Order 12/48 Fiber C Valid lines: 650/661 (type=FP) 02:04:09.823- |EXTALL[26743]|A[40-017-00051]: Order 13/48 Fiber C Valid lines: 639/651 (type=FP) 02:04:10.915- |EXTALL[26743]|A[40-017-00051]: Order 14/48 Fiber C Valid lines: 634/641 (type=FP) 02:04:11.747- |EXTALL[26743]|A[40-017-00051]: Order 15/48 Fiber C Valid lines: 629/631 (type=FP) 02:04:12.600- |EXTALL[26743]|A[40-017-00051]: Order 16/48 Fiber C Valid lines: 620/620 (type=FP) 02:04:13.511- |EXTALL[26743]|A[40-017-00051]: Order 17/48 Fiber C Valid lines: 609/610 (type=FP) 02:04:14.301- |EXTALL[26743]|A[40-017-00051]: Order 18/48 Fiber C Valid lines: 601/601 (type=FP) 02:04:15.070- |EXTALL[26743]|A[40-017-00051]: Order 19/48 Fiber C Valid lines: 591/591 (type=FP) 02:04:15.713- |EXTALL[26743]|A[40-017-00051]: Order 20/48 Fiber C Valid lines: 580/580 (type=FP) 02:04:16.468- |EXTALL[26743]|A[40-017-00051]: Order 21/48 Fiber C Valid lines: 571/571 (type=FP) 02:04:17.257- |EXTALL[26743]|A[40-017-00051]: Order 22/48 Fiber C Valid lines: 561/561 (type=FP) 02:04:18.046- |EXTALL[26743]|A[40-017-00051]: Order 23/48 Fiber C Valid lines: 543/550 (type=FP) 02:04:18.664- |EXTALL[26743]|A[40-017-00051]: Order 24/48 Fiber C Valid lines: 541/541 (type=FP) 02:04:19.377- |EXTALL[26743]|A[40-017-00051]: Order 25/48 Fiber C Valid lines: 525/531 (type=FP) 02:04:19.870- |EXTALL[26743]|A[40-017-00051]: Order 26/48 Fiber C Valid lines: 521/521 (type=FP) 02:04:20.559- |EXTALL[26743]|A[40-017-00051]: Order 27/48 Fiber C Valid lines: 511/511 (type=FP) 02:04:21.272- |EXTALL[26743]|A[40-017-00051]: Order 28/48 Fiber C Valid lines: 501/501 (type=FP) 02:04:21.804- |EXTALL[26743]|A[40-017-00051]: Order 29/48 Fiber C Valid lines: 491/491 (type=FP) 02:04:22.242- |EXTALL[26743]|A[40-017-00051]: Order 30/48 Fiber C Valid lines: 481/481 (type=FP) 02:04:22.954- |EXTALL[26743]|A[40-017-00051]: Order 31/48 Fiber C Valid lines: 472/472 (type=FP) 02:04:23.622- |EXTALL[26743]|A[40-017-00051]: Order 32/48 Fiber C Valid lines: 461/461 (type=FP) 02:04:24.124- |EXTALL[26743]|A[40-017-00051]: Order 33/48 Fiber C Valid lines: 452/452 (type=FP) 02:04:24.768- |EXTALL[26743]|A[40-017-00051]: Order 34/48 Fiber C Valid lines: 441/441 (type=FP) 02:04:25.422- |EXTALL[26743]|A[40-017-00051]: Order 35/48 Fiber C Valid lines: 432/432 (type=FP) 02:04:26.264- |EXTALL[26743]|A[40-017-00051]: Order 36/48 Fiber C Valid lines: 422/422 (type=FP) 02:04:26.810- |EXTALL[26743]|A[40-017-00051]: Order 37/48 Fiber C Valid lines: 412/412 (type=FP) 02:04:27.279- |EXTALL[26743]|A[40-017-00051]: Order 38/48 Fiber C Valid lines: 402/402 (type=FP) 02:04:27.677- |EXTALL[26743]|A[40-017-00051]: Order 39/48 Fiber C Valid lines: 392/392 (type=FP) 02:04:28.036- |EXTALL[26743]|A[40-017-00051]: Order 40/48 Fiber C Valid lines: 382/382 (type=FP) 02:04:28.394- |EXTALL[26743]|A[40-017-00051]: Order 41/48 Fiber C Valid lines: 373/373 (type=FP) 02:04:28.737- |EXTALL[26743]|A[40-017-00051]: Order 42/48 Fiber C Valid lines: 362/362 (type=FP) 02:04:29.097- |EXTALL[26743]|A[40-017-00051]: Order 43/48 Fiber C Valid lines: 353/353 (type=FP) 02:04:29.735- |EXTALL[26743]|A[40-017-00051]: Order 44/48 Fiber C Valid lines: 343/343 (type=FP) 02:04:30.305- |EXTALL[26743]|A[40-017-00051]: Order 45/48 Fiber C Valid lines: 333/333 (type=FP) 02:04:30.879- |EXTALL[26743]|A[40-017-00051]: Order 46/48 Fiber C Valid lines: 323/323 (type=FP) 02:04:31.360- |EXTALL[26743]|A[40-017-00051]: Order 47/48 Fiber C Valid lines: 313/313 (type=FP) 02:04:31.877- |EXTALL[26743]|A[40-017-00051]: Order 48/48 Fiber C Valid lines: 293/303 (type=FP) 02:04:31.918- |EXTALL[26743]|A[40-017-00039]: Saving C line file: /data/spirou4/apero-data/offline/reduced/21BQ11-Oct16/2663172o_pp_ext_fplines_C.fits 02:06:45.011-!!|EXTALL[26743]|02:06:44.988-|DatabaseError|E[00-002-00032] <class 'mysql.connector.errors.DatabaseError'>: 1205 (HY000): Lock wait timeout exceeded; try restarting transaction 02:06:45.032-!!|EXTALL[26743]| Command: INSERT INTO log_offline_db VALUES("apero_extract_spirou", "EXTALL", "red", "recipe", "extract-ALL", "EXTALL[26743]", "PID-00016937065235734798-80DG", "2023-09-03 02:02:03.573", "1693706523.573", "APEROG-PI D-00016934391638252470-QNB4_apero_processing_group", 2, 0, "num=0 fiber=C ", "/data/spirou4/apero-data/offline/tmp", "/data/spirou4/apero-data/offline/reduced", "21BQ11-Oct16", "/data/spirou4/apero-data/offline/msg/processing/APEROG-PID-0001693439 1638252470-QNB4_apero_processing_group/21BQ11-Oct16/APEROL-PID-00016937065235734798-80DG_apero_extract_spirou.log", "/data/spirou4/apero-data/offline/plot/21BQ11-Oct16/pid-00016937065235734798-80dg_apero_extract_spirou_1", "apero_extract_spirou.py 21BQ11-Oct16 2663172o_pp.fits --quicklook=False --badcorr=True --backsub=True --combine=False --combine_method=sum --darkcorr=True --fiber=ALL --flipimage=both --fluxunits=e- --plot=0 --resize=True --leakcorr=True --thermal=True --force_ref_wave= False --no_in_qc=False --program=EXTALL[26743] --recipe_kind=extract-ALL --parallel=True --shortname=EXTALL --crunfile=run_EXTALL_only.ini --nosave=False ", "obs_dir=21BQ11-Oct16 || files[1]=/data/spirou4/apero-data/offline/tmp/21BQ11-Oct16/266317 2o_pp.fits [DRS_PP]", "--quicklook=False || --badcorr=True || --backsub=True || --combine=False || --combine_method=sum || --objname=None || --dprtype=None || --darkcorr=True || --fiber=ALL || --flipimage=both || --fluxunits=e- || --plot=0 || --re size=True || --leakcorr=True || --thermal=True || --force_ref_wave=False || --no_in_qc=False", "--xhelp=None || --debug=None || --listing=None || --listingall=None || --version=None || --info=None || --program=EXTALL[26743] || --recipe_kind=extrac t-ALL || --parallel=True || --shortname=EXTALL || --idebug=None || --ref=None || --crunfile=run_EXTALL_only.ini || --quiet=None || --nosave=False || --force_indir=None || --force_outdir=None", "2023-09-03 02:02:03.573", NULL, 1, 1, "image=NaN [ima ge is all NaN] PASSED ||", "image||", "NaN||", "image is all NaN||", "1||", NULL, 0, 67, "IN_PARALLEL|RUNNING|ENDED|FORCE_REFWAVE|USER_FIBERS|QUICKLOOK|EXP_FPLINE", 1, "10.994274139404297", "-1.0", "98.2339096069336", "0.0", "-1.0", "0.0", "52.3", "-1.0", 28, "2023-09-03 02:03:33.563", NULL) 02:06:45.052-!!|EXTALL[26743]| path: /h/spdrs/.apero/apero_at_localhost 02:06:45.069-!!|EXTALL[26743]| Function: apero.base.drs_db.py.Database.execute() 02:07:09.989-|EXTALL[26743]| * 02:07:10.080-@!|EXTALL[26743]|W[40-003-00005]: Recipe apero_extract_spirou has NOT been successfully completed 02:07:10.121-**|EXTALL[26743]| ***

larnoldgithub commented 10 months ago

re-running the extraction manually worked of course. I'm thinking of re-running EXTALL again, with SKIP set to True so it would be done quite quickly I guess.

njcuk9999 commented 10 months ago

yes other than the initial set-up in apero_processing.