njcuk9999
commented
3 months ago Im not sure of the problem here but although we run LBL inside APERO, LBL and APERO work completely separately. The only link is apero_lbl_ref which symlinks files in to the lbl/calib directory. Please dont get confused between the calib dir for apero and the lbl/calib directory from lbl. As stated previously apero_lbl_ref only uses the /red/ directory not the calib dorectory from apero at all.
Extraction is done using the apero calib directory and all lbl stuff is done using the lbl/calib directory. So which are the files missing from?
Note you cannot just copy files into the apero calib directory they should be copied when calibration recipes are run and if they are not there should be a good reason for it unless the recipe crashed between saving files to the red directory and copying them to the apero calib directory.
For lbl/calib it all comes down to apero_lbl_ref as stated before maybe there is a problem in this code but the lbltcalib directory is only for lbl not anything else in apero so no apero reductions should be affected.
Note as well in the apero calib directory it only has files thag are used in other apero recipes not all calib files in the red directory are copied to the apero calib directory.
larnoldgithub
I just discoverd this for one night at least (21BQ20-Jan18) . The processing is from Oct 20 2023.
In October I have processed all calibrations, all files are in the nights directories, QC are OK.
But I recently got an error from lbl and the reason is that some FP_FP aren't present in calib/:
why all calibrations from that night have not been copied the calib/ dir, while QC are all good ?
I'm goint to copy them manually and re-run the job that failed. I guess Apero will update his calib and findex db with the new files put in calib/ In principle I also should redo the extraction etc. for that night.