search

i4Ds / STIXCore

STIX Core functionalities
BSD 3-Clause "New" or "Revised" License
3 stars 3 forks source link

Missing L1 files #348

Closed samaloney closed 1 year ago

samaloney commented 1 year ago

Hualin implemented a new feature where the download link colour indicates if there is only L1A (grey) or both L1A and L1 (blue)

I noticed a lot of grey only files where we should have L1 files. I checked a few random unique ids 2303120087, 2303133878 and 2301170650.

I did a quick file search on pub099 and the L1 versions are indeed missing:

:/data/stix/out/fits_v1.0.0$ find . -name '*2303120087*'
./LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V01_2303120087-65280.fits
./L0/21/6/21/solo_L0_stix-sci-xray-cpd_0731975306-0731977461_V01_2303120087-65280.fits
:/data/stix/out/fits_v1.0.0$ find . -name '*2303133878*'
./LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V01_2303133878-62877.fits
./L0/21/6/21/solo_L0_stix-sci-xray-cpd_0731982660-0731985860_V01_2303133878-62877.fits
:/data/stix/out/fits_v1.0.0$ find . -name '*2301170650*'
./LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V01_2301170650-63000.fits
./L0/21/6/21/solo_L0_stix-sci-xray-cpd_0727279118-0727279427_V01_2301170650-63000.fits

So then did a quick grep in the log files and sure enough we are getting some permission denied error, I guess when writing the fits files?

:/data/stix/out/fits_v1.0.0/logging$ grep -R 2301170650
pub_20230426.log:2023-04-26 05:00:21,172 processed file: [{'id': 51318, 'name': 'solo_L0_stix-sci-xray-cpd_0727279118-0727279427_V01_2301170650-63000.fits', 'path': '/data/stix/out/fits_v1.0.0/L0/21/6/21', 'version': 1, 'p_date': 1682478021.141702, 'm_date': 1682478021.1375449, 'esaname': 'solo_L0_stix-sci-xray-cpd_0727279118-0727279427_V01', 'modified_esaname': None, 'result': None}] > PublishConflicts.ADDED
TM_05PM_REQ_BatchRequest.PktTmRaw.SOL.0.2023.030.08.24.13.725.SjWJ@2023.091.12.00.01.239.4.xml.log:2023-04-04T17:56:46Z INFO stixcore.io.fits.processors 435: Writing fits file to /data/stix/out/fits_v1.0.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V01_2301170650-63000.fits
TM_05PM_REQ_BatchRequest.PktTmRaw.SOL.0.2023.030.08.24.13.725.SjWJ@2023.091.12.00.01.239.4.xml.log: PosixPath('/data/stix/out/fits_v1.0.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V01_2301170650-63000.fits'),
TM_05PM_REQ_BatchRequest.PktTmRaw.SOL.0.2023.030.08.24.13.725.SjWJ@2023.091.12.00.01.239.4.xml.log: PosixPath('/data/stix/out/fits_v1.0.0/L0/21/6/21/solo_L0_stix-sci-xray-cpd_0727279118-0727279427_V01_2301170650-63000.fits'),
TM_05PM_REQ_BatchRequest.PktTmRaw.SOL.0.2023.030.08.24.13.725.SjWJ@2023.091.12.00.01.239.4.xml.log:2023-04-04T17:58:18Z INFO stixcore.processing.L0toL1 89: processing file: /data/stix/out/fits_v1.0.0/L0/21/6/21/solo_L0_stix-sci-xray-cpd_0727279118-0727279427_V01_2301170650-63000.fits
TM_05PM_REQ_BatchRequest.PktTmRaw.SOL.0.2023.030.08.24.13.725.SjWJ@2023.091.12.00.01.239.4.xml.log:2023-04-04T17:58:18Z ERROR stixcore.processing.L0toL1 102: Error processing file /data/stix/out/fits_v1.0.0/L0/21/6/21/solo_L0_stix-sci-xray-cpd_0727279118-0727279427_V01_2301170650-63000.fits
TM_05PM_REQ_BatchRequest.PktTmRaw.SOL.0.2023.030.08.24.13.725.SjWJ@2023.091.12.00.01.239.4.xml.log:PermissionError: [Errno 13] Permission denied: '/data/stix/out/fits_v1.0.0/L1/2023/01/17/SCI/solo_L1_stix-sci-xray-cpd_20230117T140115-20230117T140624_V01_2301170650-63000.fits'
TM_05PM_REQ_BatchRequest.PktTmRaw.SOL.0.2023.030.08.24.13.725.SjWJ@2023.091.12.00.01.239.4.xml.log:2023-04-04T17:58:18Z ERROR stixcore.processing.L0toL1 103: [Errno 13] Permission denied: '/data/stix/out/fits_v1.0.0/L1/2023/01/17/SCI/solo_L1_stix-sci-xray-cpd_20230117T140115-20230117T140624_V01_2301170650-63000.fits'
TM_05PM_REQ_BatchRequest.PktTmRaw.SOL.0.2023.030.08.24.13.725.SjWJ@2023.091.12.00.01.239.4.xml.out:/data/stix/out/fits_v1.0.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V01_2301170650-63000.fits
TM_05PM_REQ_BatchRequest.PktTmRaw.SOL.0.2023.030.08.24.13.725.SjWJ@2023.091.12.00.01.239.4.xml.out:/data/stix/out/fits_v1.0.0/L0/21/6/21/solo_L0_stix-sci-xray-cpd_0727279118-0727279427_V01_2301170650-63000.fits
:/data/stix/out/fits_v1.0.0/logging$ grep -R 2303120087
manual_req_BatchRequest.PktTmRaw.SOL.0.2023.109.13.37.13.518.yofT@2023.109.13.37.15.089.2.xml.log:2023-04-21T16:00:13Z INFO stixcore.io.fits.processors 404: Fits file solo_LB_stix-21-6-21_0000000000-9999999999_V01_2303120087-65280.fits exists appending data
manual_req_BatchRequest.PktTmRaw.SOL.0.2023.109.13.37.13.518.yofT@2023.109.13.37.15.089.2.xml.log:2023-04-21T16:00:13Z INFO stixcore.io.fits.processors 435: Writing fits file to /data/stix/out/fits_v1.0.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V01_2303120087-65280.fits
manual_req_BatchRequest.PktTmRaw.SOL.0.2023.109.13.37.13.518.yofT@2023.109.13.37.15.089.2.xml.log: PosixPath('/data/stix/out/fits_v1.0.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V01_2303120087-65280.fits'),
manual_req_BatchRequest.PktTmRaw.SOL.0.2023.109.13.37.13.518.yofT@2023.109.13.37.15.089.2.xml.log:2023-04-21T16:01:04Z INFO stixcore.io.fits.processors 484: Fits file solo_L0_stix-sci-xray-cpd_0731975306-0731977461_V01_2303120087-65280.fits exists appending data
manual_req_BatchRequest.PktTmRaw.SOL.0.2023.109.13.37.13.518.yofT@2023.109.13.37.15.089.2.xml.out:/data/stix/out/fits_v1.0.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V01_2303120087-65280.fits
TM_05PM_REQ_BatchRequest.PktTmRaw.SOL.0.2023.030.08.24.13.749.YJTu@2023.109.12.00.01.424.17.xml.out:/data/stix/out/fits_v1.0.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V01_2303120087-65280.fits
TM_05PM_REQ_BatchRequest.PktTmRaw.SOL.0.2023.030.08.24.13.749.YJTu@2023.109.12.00.01.424.17.xml.out:/data/stix/out/fits_v1.0.0/L0/21/6/21/solo_L0_stix-sci-xray-cpd_0731975306-0731977461_V01_2303120087-65280.fits
TM_05PM_REQ_BatchRequest.PktTmRaw.SOL.0.2023.030.08.24.13.749.YJTu@2023.109.12.00.01.424.17.xml.log:2023-04-21T14:48:00Z INFO stixcore.io.fits.processors 435: Writing fits file to /data/stix/out/fits_v1.0.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V01_2303120087-65280.fits
TM_05PM_REQ_BatchRequest.PktTmRaw.SOL.0.2023.030.08.24.13.749.YJTu@2023.109.12.00.01.424.17.xml.log: PosixPath('/data/stix/out/fits_v1.0.0/LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V01_2303120087-65280.fits'),
TM_05PM_REQ_BatchRequest.PktTmRaw.SOL.0.2023.030.08.24.13.749.YJTu@2023.109.12.00.01.424.17.xml.log: PosixPath('/data/stix/out/fits_v1.0.0/L0/21/6/21/solo_L0_stix-sci-xray-cpd_0731975306-0731977461_V01_2303120087-65280.fits'),
TM_05PM_REQ_BatchRequest.PktTmRaw.SOL.0.2023.030.08.24.13.749.YJTu@2023.109.12.00.01.424.17.xml.log:2023-04-21T14:49:47Z INFO stixcore.processing.L0toL1 89: processing file: /data/stix/out/fits_v1.0.0/L0/21/6/21/solo_L0_stix-sci-xray-cpd_0731975306-0731977461_V01_2303120087-65280.fits
TM_05PM_REQ_BatchRequest.PktTmRaw.SOL.0.2023.030.08.24.13.749.YJTu@2023.109.12.00.01.424.17.xml.log:2023-04-21T14:49:47Z ERROR stixcore.processing.L0toL1 102: Error processing file /data/stix/out/fits_v1.0.0/L0/21/6/21/solo_L0_stix-sci-xray-cpd_0731975306-0731977461_V01_2303120087-65280.fits
TM_05PM_REQ_BatchRequest.PktTmRaw.SOL.0.2023.030.08.24.13.749.YJTu@2023.109.12.00.01.424.17.xml.log:PermissionError: [Errno 13] Permission denied: '/data/stix/out/fits_v1.0.0/L1/2023/03/12/SCI/solo_L1_stix-sci-xray-cpd_20230312T223111-20230312T230706_V01_2303120087-65280.fits'
TM_05PM_REQ_BatchRequest.PktTmRaw.SOL.0.2023.030.08.24.13.749.YJTu@2023.109.12.00.01.424.17.xml.log:2023-04-21T14:49:47Z ERROR stixcore.processing.L0toL1 103: [Errno 13] Permission denied: '/data/stix/out/fits_v1.0.0/L1/2023/03/12/SCI/solo_L1_stix-sci-xray-cpd_20230312T223111-20230312T230706_V01_2303120087-65280.fits'
nicHoch commented 1 year ago

during the cutover/merging from batch to daily processing a range of files had been owned by root. i do not know why. i change dthe owner and restarted the processing for the deticated files.

now it should be ok:

stixcore@pub099:/data/stix/out/fits_v1.0.0$ find . -name '*2303120087*'
./LB/21/6/21/solo_LB_stix-21-6-21_0000000000-9999999999_V01_2303120087-65280.fits
./L1/2023/03/12/SCI/solo_L1_stix-sci-xray-cpd_20230312T223111-20230312T230706_V01_2303120087-65280.fits
./L0/21/6/21/solo_L0_stix-sci-xray-cpd_0731975306-0731977461_V01_2303120087-65280.fits