search

olivierhagolle / Start_maja

To process a Sentinel-2 time series with MAJA cloud detection and atmospheric correction processor
Other
51 stars 15 forks source link

Multiple input / JobOrder error #10

Closed borlafgis closed 5 years ago

borlafgis commented 6 years ago

Good morning

I have been trying to use the script start_maja to process a time series of S2 data between december 2016 and january 2018. I was able to prepare the imputs and launch MAJA, although it throws an error, although I do not understand its source, as the file order seems the proper one and MAJA needs a time series (i think). Under these lines I paste the logfile, in hopes it is useful.

Kind regards, Ignacio

[I] MAJA Software Version : 1.0.0 [I] Overloads the conf value in the command line by '/home/roformon1/Workspace/MAJA/repWork/35TLK/35TLK/GIPP_MAJA_1_0_S2AS2B_NATIF//userconf'. /home/roformon1/Workspace/eodata/ProcOptic/S2-MAJA-corrected/35TLK/35TLK/GIPP_MAJA_1_0_S2AS2B_NATIF//.maja-working-directory/MAJAUserConfigSystem.xml validates [I] ------------------------------------------------------------------------- [I] Configuration User System parameters: [I] L2Note : L2 note [I] L3Note : L3 note [I] CheckToolsNote : Checktool note [I] NbThreads : 8 [I] EnableCleaningTemporaryDirectory : true [I] EnableCachingConvertReflectanceData : true [I] EnableCleaningCachingDirectoryBeforeProcessing : false [I] EnableCleaningCachingDirectoryAfterProcessing : true [I] EnableL2ResolutionProcessing : true [I] PreProcessingCleanInputZipFiles : false [I] PostProcessingZipFiles : false [I] PostProcessingCleanFiles : false [I] CheckXMLFilesWithSchema : false [I] ------------------------------------------------------------------------- [I] Using default Admin configuration system file. /home/roformon1/Workspace/eodata/ProcOptic/S2-MAJA-corrected/35TLK/35TLK/GIPP_MAJA_1_0_S2AS2B_NATIF//.maja-working-directory/MAJAAdminConfigSystem.xml validates [I] ------------------------------------------------------------------------- [I] Configuration Admin System parameters: [I] System : MAJA [I] Tolerances / Footprint / Coordinate : 1e-06 [I] '' '' / Direction : 1e-06 [I] * EnablePerformanceMeasureAlgorithms : false [I] ------------------------------------------------------------------------- [I] ** [I] Application information: [I] Processor Name : MAJA_L2_BACKWARD_CHAIN [I] Test mode : false [I] UserConfigSystemFilename : /home/roformon1/Workspace/eodata/ProcOptic/S2-MAJA-corrected/35TLK/35TLK/GIPP_MAJA_1_0_S2AS2B_NATIF//.maja-working-directory/MAJAUserConfigSystem.xml [I] AdminConfigSystemFileName : /home/roformon1/Workspace/eodata/ProcOptic/S2-MAJA-corrected/35TLK/35TLK/GIPP_MAJA_1_0_S2AS2B_NATIF//.maja-working-directory/MAJAAdminConfigSystem.xml [I] * Specifics command line parameters: [I] - TileId: 35TLK [I] ** [I] The process uses 8 thread(s). Note: possible to use of maximum 128 threads. [I] Starting L2BackwardProcessor::PreProcessing() ... [I] There are 8 L1 images products. [I] - /home/roformon1/Workspace/MAJA/repWork/35TLK/35TLK/GIPP_MAJA_1_0_S2AS2B_NATIF//in/S2A_MSIL1C_20170116T091321_N0204_R050_T35TLK_20170116T091315.SAFE/MTD_MSIL1C.xml [I] - /home/roformon1/Workspace/MAJA/repWork/35TLK/35TLK/GIPP_MAJA_1_0_S2AS2B_NATIF//in/S2A_MSIL1C_20170119T092311_N0204_R093_T35TLK_20170119T092308.SAFE/MTD_MSIL1C.xml [I] - /home/roformon1/Workspace/MAJA/repWork/35TLK/35TLK/GIPP_MAJA_1_0_S2AS2B_NATIF//in/S2A_MSIL1C_20170126T091231_N0204_R050_T35TLK_20170126T091606.SAFE/MTD_MSIL1C.xml [I] - /home/roformon1/Workspace/MAJA/repWork/35TLK/35TLK/GIPP_MAJA_1_0_S2AS2B_NATIF//in/S2A_MSIL1C_20170129T092221_N0204_R093_T35TLK_20170129T092325.SAFE/MTD_MSIL1C.xml [I] - /home/roformon1/Workspace/MAJA/repWork/35TLK/35TLK/GIPP_MAJA_1_0_S2AS2B_NATIF//in/S2A_MSIL1C_20170205T091141_N0204_R050_T35TLK_20170205T091403.SAFE/MTD_MSIL1C.xml [I] - /home/roformon1/Workspace/MAJA/repWork/35TLK/35TLK/GIPP_MAJA_1_0_S2AS2B_NATIF//in/S2A_MSIL1C_20170208T092131_N0204_R093_T35TLK_20170208T092143.SAFE/MTD_MSIL1C.xml [I] - /home/roformon1/Workspace/MAJA/repWork/35TLK/35TLK/GIPP_MAJA_1_0_S2AS2B_NATIF//in/S2A_MSIL1C_20170215T091041_N0204_R050_T35TLK_20170215T091040.SAFE/MTD_MSIL1C.xml [I] - /home/roformon1/Workspace/MAJA/repWork/35TLK/35TLK/GIPP_MAJA_1_0_S2AS2B_NATIF//in/S2A_MSIL1C_20170218T092031_N0204_R093_T35TLK_20170218T092738.SAFE/MTDMSIL1C.xml [P] ----------------------------------------------------------------------------------------------- [P] Starting L2Processor::PreProcessing() ... [I] List of the 1 satellite(s) activated : [I] - SENTINEL-2A ('common' satellite SENTINEL-2 and plugin SENTINEL2) [I] Starting reading and checking input data common for each plugin activated... [I] According to the input data, there is(are) 1 plugin(s) activated: [I] - SENTINEL2 [E] vns::Data::ERROR: DataApplicationHandler(0xf7c760): DataApplicationHandler::GetGippFilename: Most of one input filenames have been found for the File_Type 'AUXREFDE2' and for the satellite 'SENTINEL-2'. The input directory contains more than one input data or the JobOrder doesn't respect the format ! [vnsDataApplicationHandler.cxx:GetGippFilename:1415] [E] ** [vnsMajaMainProcessor.cxx:main:127] [E] PreProcessing: vns::Data::ERROR: DataApplicationHandler(0xf7c760): DataApplicationHandler::GetGippFilename: Most of one input filenames have been found for the File_Type 'AUXREFDE2' and for the satellite 'SENTINEL-2'. The input directory contains more than one input data or the JobOrder doesn't respect the format ! [vnsDataApplicationHandler.cxx:1415] [MAJA Data Exception] [vnsMajaMainProcessor.cxx:main:127] [E] [vnsMajaMainProcessor.cxx:main:127] [E] ** [vnsMajaMainProcessor.cxx:main:127]

olivierhagolle commented 6 years ago

Hi Ignacio, could you please also provide the command line you used ? Thanks, Olivier

borlafgis commented 6 years ago

Hello Oliver

The line is:

python start_maja.py -f ~/Workspace/MAJA/MAJAws.txt -c GIPP_MAJA_1_0_S2AS2B_NATIF -t 35TLL -s 35TLL -d 01012017

The contents of the MAJAws.txt file are:

repCode=/home/roformon1/Workspace/MAJA/repCode repWork=/home/roformon1/Workspace/MAJA/repWork repL1 =/home/roformon1/Workspace/eodata/RAWoptic/S2 repL2 =/home/roformon1/Workspace/eodata/ProcOptic/S2-MAJA-corrected repMaja=/opt/maja/core/1.0/bin/maja

repCode contains the folders DTM, GIPP_MAJA_1_0_S2AS2B_NATIF and userconf, as well as the text files lance_maja.py, start_maja.py and Readme.md. repL1contains the folders of the images in the time series

Thanks, Ignacio

olivierhagolle commented 6 years ago

Thanks, There is an error in the command line, the date format should be 20170101.

-The error message means nothing (the English skills of MAJA developper were quite poor...). We have had it changed, in the next version. Meanwhile you try to provide a correct date, I will search for what the message means. Best regards, Olivier

olivierhagolle commented 6 years ago

If it does not work, could you please list the DTM directory you have ? It seems that the error message corresponds to the existence of several DTM directories for the same tile Olivier

borlafgis commented 6 years ago

Inside the DTM directory I have two folders, one for the tile 35TLK and another for the tile 35TLL, inside of each I have the DIR and the HDR files

S2__TEST_AUX_REFDE2_T35TLK_0001

S2__TEST_AUX_REFDE2_T35TLL_0001

olivierhagolle commented 6 years ago

Looks good... We need to search for something else...

Did you try to change the date as I recommended above ?

'python start_maja.py -f ~/Workspace/MAJA/MAJAws.txt -c GIPP_MAJA_1_0_S2AS2B_NATIF -t 35TLL -s 35TLL -d 20170101'

olivierhagolle commented 6 years ago

Just wondering, are your L1C data within: /home/roformon1/Workspace/eodata/RAWoptic/S2/35TLL/35TLL ?

olivierhagolle commented 6 years ago

And as my colleague Bruno noticed, the command line should be: python start_maja.py -f ~/Workspace/MAJA/MAJAws.txt -c MAJA_1_0_S2AS2B_NATIF -t 35TLL -s 35TLL -d 20170101'

The -c option must be provided without "GIPP_". I should change that feature, you are not the first to stumble upon... Olivier

borlafgis commented 6 years ago

I tried with the proper date formatting, but I get the same error. With respect with the file organization, you are right, the path is /home/roformon1/Workspace/eodata/RAWoptic/S2/35TLL/ and inside of that folder I have the images.

olivierhagolle commented 6 years ago

it should be /home/roformon1/Workspace/eodata/RAWoptic/S2/35TLL//35TLL

Usualy, we use that to get regroup tiles per countries or regions: for instance .../Workspace/eodata/RAWoptic/S2/France/31TCJ

And please try after having changed .../Workspace/eodata/RAWoptic/S2/your_region/35TLL python start_maja.py -f ~/Workspace/MAJA/MAJAws.txt -c MAJA_1_0_S2AS2B_NATIF -s your_region -t 35TLL -d 20170101', without GIPP in the -c name.

borlafgis commented 6 years ago

I tried with that structure, and the following command

python start_maja.py -f ~/Workspace/MAJA/MAJAws.txt -c MAJA_1_0_S2AS2B_NATIF -t 35TLL -s interest -d 20170101

I get the following error message:

No L1C product found in /home/roformon1/Workspace/eodata/RAWoptic/S2/interest//S2?_OPER_PRD_MSIL1C.SAFE/GRANULE/35TLL or /home/roformon1/Workspace/eodata/RAWoptic/S2/interest//S2?_MSIL1C.SAFE/GRANULE/35TLL

olivierhagolle commented 6 years ago

Oh, sorry, you were right and I was wrong The S2 products should be there: /home/roformon1/Workspace/eodata/RAWoptic/S2/interest/ (without 35TLL)

borlafgis commented 6 years ago

I tried to re-do everything and make a fresh start, and, for now, it seems to run (it hasn't thrown an error yet). I think the problem was a stray duplicate file. If you want, I can comment again if it finishes succesfully to make sure if that was the problem

olivierhagolle commented 6 years ago

Good news ! Happy to count you among MAJA users. Please let me know about your results. Olivier

borlafgis commented 6 years ago

Hello

I am afraid It failed again, I receive the following message

2018-06-29T20:25:34.520328 localhost.localdomain maja-processing 01.00 [000000015596] [E] vns::Data::ERROR: XMLFileHandler(0x3f230f0): XMLFileHandler::LoadFile: Error while loading the file [/home/roformon1/Workspace/MAJA/repWork/35TLL/35TLL/MAJA_1_0_S2AS2B_NATIF/in/S2A_MSIL1C_20170218T092031_N0204_R093_T35TLL_20170218T092025.SAFE/GRANULE/L1C_T35TLL_A008670_20170218T092025/../../GRANULE/L1C_T35TLL_A008670_20170218T092025/QI_DATA/MSK_SATURA_B8A.gml]. Parsed with errors

2018-06-29T20:25:34.611148 localhost.localdomain maja-processing 01.00 [000000015596] [E] ******************************************************************************************************  [vnsMajaMainProcessor.cxx:main:128]

2018-06-29T20:25:34.625945 localhost.localdomain maja-processing 01.00 [000000015596] [E] ScientificProcessing: vns::Data::ERROR: XMLFileHandler(0x3f230f0): XMLFileHandler::LoadFile: Error while loading the file [/home/roformon1/Workspace/MAJA/repWork/35TLL/35TLL/MAJA_1_0_S2AS2B_NATIF/in/S2A_MSIL1C_20170218T092031_N0204_R093_T35TLL_20170218T092025.SAFE/GRANULE/L1C_T35TLL_A008670_20170218T092025/../../GRANULE/L1C_T35TLL_A008670_20170218T092025/QI_DATA/MSK_SATURA_B8A.gml]. Parsed with errors

2018-06-29T20:25:34.665499 localhost.localdomain maja-processing 01.00 [000000015596] [E]   [vnsMajaMainProcessor.cxx:main:128]

2018-06-29T20:25:34.678871 localhost.localdomain maja-processing 01.00 [000000015596] [E] ******************************************************************************************************  [vnsMajaMainProcessor.cxx:main:128]

I think It might be a problem with the data, I checked, and that specific image seems to not contain the file "MSK_SATURA_B8A.gml"

It is a common problem?

Kind regards, Ignacio

olivierhagolle commented 6 years ago

Hi Ignacio, I have never seen that issue yet. Maybe something happened when it was downloaded ? Could you try downloading it again ?

If the issue is still there, as a workaround, and since the saturated pixels are not frequent, you might try to copy a saturation file from another image from the same tile and same path number. I never tried that, but if MAJA does not check the date (I don't know), it might work.

Saturations ocur mainly above clouds, so it would be a good idear to take it from a rather cloud free product.

Best regards, Olivier

borlafgis commented 6 years ago

Hello Oliver,

I re-downloaded, and it seems the file is there. I checked the files and it seems that only the files I downloaded recently do have the "MSK_SATURA_B8A.gml", whereas those downloaded by my supervirsor some time ago do not. I am re-downloading those, and I will try again. Hopefully, It will work.

Kind regards, Ignacio

borlafgis commented 6 years ago

Hello Oliver

I'm very sorry for my insestence, but now it throws a new error. I paste here the message

ERROR 1: /home/roformon1/Workspace/MAJA/repWork/35TLL/35TLL/MAJA_1_0_S2AS2B_NATIF/in/S2A_MSIL1C_20170126T091231_N0204_R050_T35TLL_20170126T091606.SAFE/GRANULE/L1C_T35TLL_A008341_20170126T091606/IMG_DATA/T35TLL_20170126T091231_B01.jp2:Not a TIFF file, bad magic number 0 (0x0)
ERROR 1: /home/roformon1/Workspace/MAJA/repWork/35TLL/35TLL/MAJA_1_0_S2AS2B_NATIF/in/S2A_MSIL1C_20170126T091231_N0204_R050_T35TLL_20170126T091606.SAFE/GRANULE/L1C_T35TLL_A008341_20170126T091606/IMG_DATA/T35TLL_20170126T091231_B02.jp2:Not a TIFF file, bad magic number 0 (0x0)
ERROR 1: /home/roformon1/Workspace/MAJA/repWork/35TLL/35TLL/MAJA_1_0_S2AS2B_NATIF/in/S2A_MSIL1C_20170126T091231_N0204_R050_T35TLL_20170126T091606.SAFE/GRANULE/L1C_T35TLL_A008341_20170126T091606/IMG_DATA/T35TLL_20170126T091231_B03.jp2:Not a TIFF file, bad magic number 0 (0x0)
ERROR 1: /home/roformon1/Workspace/MAJA/repWork/35TLL/35TLL/MAJA_1_0_S2AS2B_NATIF/in/S2A_MSIL1C_20170126T091231_N0204_R050_T35TLL_20170126T091606.SAFE/GRANULE/L1C_T35TLL_A008341_20170126T091606/IMG_DATA/T35TLL_20170126T091231_B04.jp2:Not a TIFF file, bad magic number 0 (0x0)
ERROR 1: /home/roformon1/Workspace/MAJA/repWork/35TLL/35TLL/MAJA_1_0_S2AS2B_NATIF/in/S2A_MSIL1C_20170126T091231_N0204_R050_T35TLL_20170126T091606.SAFE/GRANULE/L1C_T35TLL_A008341_20170126T091606/IMG_DATA/T35TLL_20170126T091231_B05.jp2:Not a TIFF file, bad magic number 0 (0x0)
ERROR 1: /home/roformon1/Workspace/MAJA/repWork/35TLL/35TLL/MAJA_1_0_S2AS2B_NATIF/in/S2A_MSIL1C_20170126T091231_N0204_R050_T35TLL_20170126T091606.SAFE/GRANULE/L1C_T35TLL_A008341_20170126T091606/IMG_DATA/T35TLL_20170126T091231_B06.jp2:Not a TIFF file, bad magic number 0 (0x0)
ERROR 1: /home/roformon1/Workspace/MAJA/repWork/35TLL/35TLL/MAJA_1_0_S2AS2B_NATIF/in/S2A_MSIL1C_20170126T091231_N0204_R050_T35TLL_20170126T091606.SAFE/GRANULE/L1C_T35TLL_A008341_20170126T091606/IMG_DATA/T35TLL_20170126T091231_B07.jp2:Not a TIFF file, bad magic number 0 (0x0)
ERROR 1: /home/roformon1/Workspace/MAJA/repWork/35TLL/35TLL/MAJA_1_0_S2AS2B_NATIF/in/S2A_MSIL1C_20170126T091231_N0204_R050_T35TLL_20170126T091606.SAFE/GRANULE/L1C_T35TLL_A008341_20170126T091606/IMG_DATA/T35TLL_20170126T091231_B08.jp2:Not a TIFF file, bad magic number 0 (0x0)
ERROR 1: /home/roformon1/Workspace/MAJA/repWork/35TLL/35TLL/MAJA_1_0_S2AS2B_NATIF/in/S2A_MSIL1C_20170126T091231_N0204_R050_T35TLL_20170126T091606.SAFE/GRANULE/L1C_T35TLL_A008341_20170126T091606/IMG_DATA/T35TLL_20170126T091231_B8A.jp2:Not a TIFF file, bad magic number 0 (0x0)
ERROR 1: /home/roformon1/Workspace/MAJA/repWork/35TLL/35TLL/MAJA_1_0_S2AS2B_NATIF/in/S2A_MSIL1C_20170126T091231_N0204_R050_T35TLL_20170126T091606.SAFE/GRANULE/L1C_T35TLL_A008341_20170126T091606/IMG_DATA/T35TLL_20170126T091231_B09.jp2:Not a TIFF file, bad magic number 0 (0x0)
ERROR 1: /home/roformon1/Workspace/MAJA/repWork/35TLL/35TLL/MAJA_1_0_S2AS2B_NATIF/in/S2A_MSIL1C_20170126T091231_N0204_R050_T35TLL_20170126T091606.SAFE/GRANULE/L1C_T35TLL_A008341_20170126T091606/IMG_DATA/T35TLL_20170126T091231_B10.jp2:Not a TIFF file, bad magic number 0 (0x0)
ERROR 1: /home/roformon1/Workspace/MAJA/repWork/35TLL/35TLL/MAJA_1_0_S2AS2B_NATIF/in/S2A_MSIL1C_20170126T091231_N0204_R050_T35TLL_20170126T091606.SAFE/GRANULE/L1C_T35TLL_A008341_20170126T091606/IMG_DATA/T35TLL_20170126T091231_B11.jp2:Not a TIFF file, bad magic number 0 (0x0)
ERROR 1: /home/roformon1/Workspace/MAJA/repWork/35TLL/35TLL/MAJA_1_0_S2AS2B_NATIF/in/S2A_MSIL1C_20170126T091231_N0204_R050_T35TLL_20170126T091606.SAFE/GRANULE/L1C_T35TLL_A008341_20170126T091606/IMG_DATA/T35TLL_20170126T091231_B12.jp2:Not a TIFF file, bad magic number 0 (0x0)
2018-07-04T21:14:02.621284 localhost.localdomain maja-processing 01.00 [000000095907] [E] ******************************************************************************************************  [vnsMajaMainProcessor.cxx:main:128]
2018-07-04T21:14:02.796529 localhost.localdomain maja-processing 01.00 [000000095907] [E] ScientificProcessing: ITK Exception: itk::ERROR: PersistentStreamingMaskConditionalStatisticsVectorImageFilter(0x84bd270): Inputs do not occupy the same physical space! 
InputImage Origin: [3.0012000e+05, 5.0999200e+06], InputImage_1 Origin: [3.0012000e+05, 5.0998800e+06]
    Tolerance: 2.4000000e-04
 [itkImageToImageFilter.hxx:248]  [vnsMajaMainProcessor.cxx:main:128]
2018-07-04T21:14:02.848829 localhost.localdomain maja-processing 01.00 [000000095907] [E]   [vnsMajaMainProcessor.cxx:main:128]
2018-07-04T21:14:02.868060 localhost.localdomain maja-processing 01.00 [000000095907] [E] ******************************************************************************************************  [vnsMajaMainProcessor.cxx:main:128]

This time I do not have any idea about what might be failing

Best regards, Ignacio

olivierhagolle commented 6 years ago

Hi Ignaciio, don't worry about the ERROR1, it is a warning coming from Gdal.

The other one is a new one that we have never met after having processed more than 200 000 images. Does it happen for each image, or only once ? Could you provide the command line and the MAJA logfile for the product that fails ?,
Best regards, Olivier

borlafgis commented 6 years ago

Hello Oliver

I do not really know, I did this experiment having the complete time series in the input directory, ti fails and it stops

The command line is:

python start_maja.py -f ~/Workspace/MAJA/MAJAws.txt -c MAJA_1_0_S2AS2B_NATIF -t 35TLL -s 35TLL -d 20161201

The entire logfile is:

 localhost.localdomain maja-processing 01.00 [000000095907] [I]     *      Tolerances / Footprint / Coordinate             : 1e-06
2018-07-04T18:43:05.813149 localhost.localdomain maja-processing 01.00 [000000095907] [I]     *           ''          ''    / Direction              : 1e-06
2018-07-04T18:43:05.858873 localhost.localdomain maja-processing 01.00 [000000095907] [I]     *      EnablePerformanceMeasureAlgorithms              : false
2018-07-04T18:43:05.905020 localhost.localdomain maja-processing 01.00 [000000095907] [I] -------------------------------------------------------------------------
2018-07-04T18:43:05.911327 localhost.localdomain maja-processing 01.00 [000000095907] [I] ******************************************************************************
2018-07-04T18:43:05.928555 localhost.localdomain maja-processing 01.00 [000000095907] [I] Application information: 
2018-07-04T18:43:05.934799 localhost.localdomain maja-processing 01.00 [000000095907] [I]     *      Processor Name               : MAJA_L2_BACKWARD_CHAIN
2018-07-04T18:43:05.942035 localhost.localdomain maja-processing 01.00 [000000095907] [I]     *      Test mode                    : false
2018-07-04T18:43:05.948189 localhost.localdomain maja-processing 01.00 [000000095907] [I]     *      UserConfigSystemFilename     : /home/roformon1/Workspace/eodata/ProcOptic/S2-MAJA-corrected/35TLL/35TLL/MAJA_1_0_S2AS2B_NATIF//.maja-working-directory/MAJAUserConfigSystem.xml
2018-07-04T18:43:05.955806 localhost.localdomain maja-processing 01.00 [000000095907] [I]     *      AdminConfigSystemFileName    : /home/roformon1/Workspace/eodata/ProcOptic/S2-MAJA-corrected/35TLL/35TLL/MAJA_1_0_S2AS2B_NATIF//.maja-working-directory/MAJAAdminConfigSystem.xml
2018-07-04T18:43:05.962243 localhost.localdomain maja-processing 01.00 [000000095907] [I]     *      Specifics command line parameters:
2018-07-04T18:43:05.968769 localhost.localdomain maja-processing 01.00 [000000095907] [I]           - TileId: 35TLL
2018-07-04T18:43:05.974622 localhost.localdomain maja-processing 01.00 [000000095907] [I] ******************************************************************************
2018-07-04T18:43:05.980518 localhost.localdomain maja-processing 01.00 [000000095907] [I] The process uses 8 thread(s). Note: possible to use of maximum 128 threads.
2018-07-04T18:43:05.995209 localhost.localdomain maja-processing 01.00 [000000095907] [I] Starting L2BackwardProcessor::PreProcessing() ...
2018-07-04T18:43:09.358135 localhost.localdomain maja-processing 01.00 [000000095907] [I] There are 8 L1 images products.
2018-07-04T18:43:09.406372 localhost.localdomain maja-processing 01.00 [000000095907] [I]  - /home/roformon1/Workspace/MAJA/repWork/35TLL/35TLL/MAJA_1_0_S2AS2B_NATIF//in/S2A_MSIL1C_20161207T091352_N0204_R050_T35TLL_20161207T091348.SAFE/MTD_MSIL1C.xml
2018-07-04T18:43:09.414017 localhost.localdomain maja-processing 01.00 [000000095907] [I]  - /home/roformon1/Workspace/MAJA/repWork/35TLL/35TLL/MAJA_1_0_S2AS2B_NATIF//in/S2A_MSIL1C_20161217T091402_N0204_R050_T35TLL_20161217T091648.SAFE/MTD_MSIL1C.xml
2018-07-04T18:43:09.427355 localhost.localdomain maja-processing 01.00 [000000095907] [I]  - /home/roformon1/Workspace/MAJA/repWork/35TLL/35TLL/MAJA_1_0_S2AS2B_NATIF//in/S2A_MSIL1C_20161220T092402_N0204_R093_T35TLL_20161220T092404.SAFE/MTD_MSIL1C.xml
2018-07-04T18:43:09.446103 localhost.localdomain maja-processing 01.00 [000000095907] [I]  - /home/roformon1/Workspace/MAJA/repWork/35TLL/35TLL/MAJA_1_0_S2AS2B_NATIF//in/S2A_MSIL1C_20161227T091402_N0204_R050_T35TLL_20161227T091446.SAFE/MTD_MSIL1C.xml
2018-07-04T18:43:09.454765 localhost.localdomain maja-processing 01.00 [000000095907] [I]  - /home/roformon1/Workspace/MAJA/repWork/35TLL/35TLL/MAJA_1_0_S2AS2B_NATIF//in/S2A_MSIL1C_20161230T092402_N0204_R093_T35TLL_20161230T092401.SAFE/MTD_MSIL1C.xml
2018-07-04T18:43:09.501815 localhost.localdomain maja-processing 01.00 [000000095907] [I]  - /home/roformon1/Workspace/MAJA/repWork/35TLL/35TLL/MAJA_1_0_S2AS2B_NATIF//in/S2A_MSIL1C_20170116T091321_N0204_R050_T35TLL_20170116T091315.SAFE/MTD_MSIL1C.xml
2018-07-04T18:43:09.552842 localhost.localdomain maja-processing 01.00 [000000095907] [I]  - /home/roformon1/Workspace/MAJA/repWork/35TLL/35TLL/MAJA_1_0_S2AS2B_NATIF//in/S2A_MSIL1C_20170119T092311_N0204_R093_T35TLL_20170119T092308.SAFE/MTD_MSIL1C.xml
2018-07-04T18:43:09.599998 localhost.localdomain maja-processing 01.00 [000000095907] [I]  - /home/roformon1/Workspace/MAJA/repWork/35TLL/35TLL/MAJA_1_0_S2AS2B_NATIF//in/S2A_MSIL1C_20170126T091231_N0204_R050_T35TLL_20170126T091606.SAFE/MTD_MSIL1C.xml
2018-07-04T18:43:12.056879 localhost.localdomain maja-processing 01.00 [000000095907] [P] -----------------------------------------------------------------------------------------------
2018-07-04T18:43:12.124662 localhost.localdomain maja-processing 01.00 [000000095907] [P] Starting L2Processor::PreProcessing() ...
2018-07-04T18:43:12.136704 localhost.localdomain maja-processing 01.00 [000000095907] [I] List of the 1 satellite(s) activated :
2018-07-04T18:43:12.145214 localhost.localdomain maja-processing 01.00 [000000095907] [I]  - SENTINEL-2A ('common' satellite SENTINEL-2_ and plugin SENTINEL2)
2018-07-04T18:43:12.185651 localhost.localdomain maja-processing 01.00 [000000095907] [I] Starting reading and checking input data common for each plugin activated...
2018-07-04T18:43:12.205768 localhost.localdomain maja-processing 01.00 [000000095907] [I] According to the input data, there is(are) 1 plugin(s) activated:
2018-07-04T18:43:12.213353 localhost.localdomain maja-processing 01.00 [000000095907] [I]  - SENTINEL2
2018-07-04T18:43:12.235895 localhost.localdomain maja-processing 01.00 [000000095907] [I] Starting DEM reading data for the 'unique' (common) satellite 'SENTINEL-2_' ...
2018-07-04T18:43:12.243910 localhost.localdomain maja-processing 01.00 [000000095907] [I] UnCompress the DBL product </home/roformon1/Workspace/MAJA/repWork/35TLL/35TLL/MAJA_1_0_S2AS2B_NATIF/in/S2__TEST_AUX_REFDE2_T35TLL_0001.DBL> ...
2018-07-04T18:43:12.251257 localhost.localdomain maja-processing 01.00 [000000095907] [I] The DBL product </home/roformon1/Workspace/MAJA/repWork/35TLL/35TLL/MAJA_1_0_S2AS2B_NATIF/in/S2__TEST_AUX_REFDE2_T35TLL_0001.DBL> is already uncompressed (.DBL.DIR directory already exists).
2018-07-04T18:43:12.263282 localhost.localdomain maja-processing 01.00 [000000095907] [I] l_NumberOfL2Resolution : 2
2018-07-04T18:43:12.270652 localhost.localdomain maja-processing 01.00 [000000095907] [I] Starting DTM reading ...
2018-07-04T18:43:12.303227 localhost.localdomain maja-processing 01.00 [000000095907] [I] UnCompress the DBL product </home/roformon1/Workspace/MAJA/repWork/35TLL/35TLL/MAJA_1_0_S2AS2B_NATIF/in/S2__TEST_AUX_REFDE2_T35TLL_0001.DBL> ...
2018-07-04T18:43:12.310396 localhost.localdomain maja-processing 01.00 [000000095907] [I] The DBL product </home/roformon1/Workspace/MAJA/repWork/35TLL/35TLL/MAJA_1_0_S2AS2B_NATIF/in/S2__TEST_AUX_REFDE2_T35TLL_0001.DBL> is already uncompressed (.DBL.DIR directory already exists).
2018-07-04T18:43:12.323263 localhost.localdomain maja-processing 01.00 [000000095907] [I] Starting DTM reading (nb resolutions=2) ...
2018-07-04T18:43:13.629664 localhost.localdomain maja-processing 01.00 [000000095907] [I] In the input data directory, there is(are) 0 meteo filename (EXO_METDTA).
2018-07-04T18:43:13.725457 localhost.localdomain maja-processing 01.00 [000000095907] [I] Starting reading and checking input data for all satellites activated...
2018-07-04T18:43:13.758536 localhost.localdomain maja-processing 01.00 [000000095907] [I] Initialize the Plugin instance detected with the Plugin Name 'SENTINEL2' ...
/home/roformon1/Workspace/eodata/ProcOptic/S2-MAJA-corrected/35TLL/35TLL/MAJA_1_0_S2AS2B_NATIF//.maja-working-directory/MAJAUserConfig_SENTINEL2.xml validates
2018-07-04T18:43:13.834264 localhost.localdomain maja-processing 01.00 [000000095907] [I] The number of streaming lines of buffer for reading/writing images is '800'.
2018-07-04T18:43:13.887419 localhost.localdomain maja-processing 01.00 [000000095907] [I] Using default Admin configuration camera file.
/home/roformon1/Workspace/eodata/ProcOptic/S2-MAJA-corrected/35TLL/35TLL/MAJA_1_0_S2AS2B_NATIF//.maja-working-directory/MAJAAdminConfig_SENTINEL2.xml validates
2018-07-04T18:43:13.963087 localhost.localdomain maja-processing 01.00 [000000095907] [I] Starting reading data for the satellite 'SENTINEL-2A' and the plugin used is 'SENTINEL2' ...
2018-07-04T18:43:14.011994 localhost.localdomain maja-processing 01.00 [000000095907] [P] Starting GIP_L2SMAC reading ...
2018-07-04T18:43:14.021369 localhost.localdomain maja-processing 01.00 [000000095907] [P] Starting GIP_L2TOCR reading ...
2018-07-04T18:43:14.030625 localhost.localdomain maja-processing 01.00 [000000095907] [I] UnCompress the DBL product </home/roformon1/Workspace/MAJA/repWork/35TLL/35TLL/MAJA_1_0_S2AS2B_NATIF/in/S2A_TEST_GIP_L2TOCR_L_CONTINEN_10002_20150703_21000101.DBL> ...
2018-07-04T18:43:14.039375 localhost.localdomain maja-processing 01.00 [000000095907] [I] The DBL product </home/roformon1/Workspace/MAJA/repWork/35TLL/35TLL/MAJA_1_0_S2AS2B_NATIF/in/S2A_TEST_GIP_L2TOCR_L_CONTINEN_10002_20150703_21000101.DBL> is already uncompressed (.DBL.DIR directory already exists).
2018-07-04T18:43:14.154881 localhost.localdomain maja-processing 01.00 [000000095907] [P] Starting GIP_L2WATV reading ...
2018-07-04T18:43:14.165272 localhost.localdomain maja-processing 01.00 [000000095907] [I] UnCompress the DBL product </home/roformon1/Workspace/MAJA/repWork/35TLL/35TLL/MAJA_1_0_S2AS2B_NATIF/in/S2A_TEST_GIP_L2WATV_L_CONTINEN_10002_20150703_21000101.DBL> ...
2018-07-04T18:43:14.173457 localhost.localdomain maja-processing 01.00 [000000095907] [I] The DBL product </home/roformon1/Workspace/MAJA/repWork/35TLL/35TLL/MAJA_1_0_S2AS2B_NATIF/in/S2A_TEST_GIP_L2WATV_L_CONTINEN_10002_20150703_21000101.DBL> is already uncompressed (.DBL.DIR directory already exists).
2018-07-04T18:43:14.182036 localhost.localdomain maja-processing 01.00 [000000095907] [I] Allocating LookUpTable image dimension = 3
2018-07-04T18:43:14.194440 localhost.localdomain maja-processing 01.00 [000000095907] [P] Starting GIP_L2DIRT reading ...
2018-07-04T18:43:14.205277 localhost.localdomain maja-processing 01.00 [000000095907] [I] UnCompress the DBL product </home/roformon1/Workspace/MAJA/repWork/35TLL/35TLL/MAJA_1_0_S2AS2B_NATIF/in/S2A_TEST_GIP_L2DIRT_L_CONTINEN_10002_20150703_21000101.DBL> ...
2018-07-04T18:43:14.213414 localhost.localdomain maja-processing 01.00 [000000095907] [I] The DBL product </home/roformon1/Workspace/MAJA/repWork/35TLL/35TLL/MAJA_1_0_S2AS2B_NATIF/in/S2A_TEST_GIP_L2DIRT_L_CONTINEN_10002_20150703_21000101.DBL> is already uncompressed (.DBL.DIR directory already exists).
2018-07-04T18:43:14.229692 localhost.localdomain maja-processing 01.00 [000000095907] [P] Starting GIP_L2DIFT reading ...
2018-07-04T18:43:14.238354 localhost.localdomain maja-processing 01.00 [000000095907] [I] UnCompress the DBL product </home/roformon1/Workspace/MAJA/repWork/35TLL/35TLL/MAJA_1_0_S2AS2B_NATIF/in/S2A_TEST_GIP_L2DIFT_L_CONTINEN_10002_20150703_21000101.DBL> ...
2018-07-04T18:43:14.248542 localhost.localdomain maja-processing 01.00 [000000095907] [I] The DBL product </home/roformon1/Workspace/MAJA/repWork/35TLL/35TLL/MAJA_1_0_S2AS2B_NATIF/in/S2A_TEST_GIP_L2DIFT_L_CONTINEN_10002_20150703_21000101.DBL> is already uncompressed (.DBL.DIR directory already exists).
2018-07-04T18:43:14.281638 localhost.localdomain maja-processing 01.00 [000000095907] [P] Starting GIP_L2ALBD reading ...
2018-07-04T18:43:14.293057 localhost.localdomain maja-processing 01.00 [000000095907] [I] UnCompress the DBL product </home/roformon1/Workspace/MAJA/repWork/35TLL/35TLL/MAJA_1_0_S2AS2B_NATIF/in/S2A_TEST_GIP_L2ALBD_L_CONTINEN_10003_20150703_21000101.DBL> ...
2018-07-04T18:43:14.316899 localhost.localdomain maja-processing 01.00 [000000095907] [I] The DBL product </home/roformon1/Workspace/MAJA/repWork/35TLL/35TLL/MAJA_1_0_S2AS2B_NATIF/in/S2A_TEST_GIP_L2ALBD_L_CONTINEN_10003_20150703_21000101.DBL> is already uncompressed (.DBL.DIR directory already exists).
2018-07-04T18:43:14.368375 localhost.localdomain maja-processing 01.00 [000000095907] [P] Starting L2Processor::PreProcessing() done.
2018-07-04T18:43:14.418951 localhost.localdomain maja-processing 01.00 [000000095907] [I] L2BackwardProcessor::PreProcessing() done.
2018-07-04T18:43:14.479884 localhost.localdomain maja-processing 01.00 [000000095907] [I] Starting L2BackwardProcessor::ScientificProcessing() ...
ERROR 1: /home/roformon1/Workspace/MAJA/repWork/35TLL/35TLL/MAJA_1_0_S2AS2B_NATIF/in/S2A_MSIL1C_20170126T091231_N0204_R050_T35TLL_20170126T091606.SAFE/GRANULE/L1C_T35TLL_A008341_20170126T091606/IMG_DATA/T35TLL_20170126T091231_B01.jp2:Not a TIFF file, bad magic number 0 (0x0)
2018-07-04T18:43:14.748057 localhost.localdomain maja-processing 01.00 [000000095907] [I] Initialize the Plugin instance detected with the Plugin Name 'SENTINEL2' ...
/home/roformon1/Workspace/eodata/ProcOptic/S2-MAJA-corrected/35TLL/35TLL/MAJA_1_0_S2AS2B_NATIF//.maja-working-directory/MAJAUserConfig_SENTINEL2.xml validates
2018-07-04T18:43:14.825122 localhost.localdomain maja-processing 01.00 [000000095907] [I] The number of streaming lines of buffer for reading/writing images is '800'.
2018-07-04T18:43:14.834786 localhost.localdomain maja-processing 01.00 [000000095907] [I] Using default Admin configuration camera file.
/home/roformon1/Workspace/eodata/ProcOptic/S2-MAJA-corrected/35TLL/35TLL/MAJA_1_0_S2AS2B_NATIF//.maja-working-directory/MAJAAdminConfig_SENTINEL2.xml validates
2018-07-04T18:43:14.868326 localhost.localdomain maja-processing 01.00 [000000095907] [I] Start Sentinel2 L1 ImageFileReader ...
ERROR 1: /home/roformon1/Workspace/MAJA/repWork/35TLL/35TLL/MAJA_1_0_S2AS2B_NATIF/in/S2A_MSIL1C_20170126T091231_N0204_R050_T35TLL_20170126T091606.SAFE/GRANULE/L1C_T35TLL_A008341_20170126T091606/IMG_DATA/T35TLL_20170126T091231_B01.jp2:Not a TIFF file, bad magic number 0 (0x0)
ERROR 1: /home/roformon1/Workspace/MAJA/repWork/35TLL/35TLL/MAJA_1_0_S2AS2B_NATIF/in/S2A_MSIL1C_20170126T091231_N0204_R050_T35TLL_20170126T091606.SAFE/GRANULE/L1C_T35TLL_A008341_20170126T091606/IMG_DATA/T35TLL_20170126T091231_B02.jp2:Not a TIFF file, bad magic number 0 (0x0)
ERROR 1: /home/roformon1/Workspace/MAJA/repWork/35TLL/35TLL/MAJA_1_0_S2AS2B_NATIF/in/S2A_MSIL1C_20170126T091231_N0204_R050_T35TLL_20170126T091606.SAFE/GRANULE/L1C_T35TLL_A008341_20170126T091606/IMG_DATA/T35TLL_20170126T091231_B03.jp2:Not a TIFF file, bad magic number 0 (0x0)
ERROR 1: /home/roformon1/Workspace/MAJA/repWork/35TLL/35TLL/MAJA_1_0_S2AS2B_NATIF/in/S2A_MSIL1C_20170126T091231_N0204_R050_T35TLL_20170126T091606.SAFE/GRANULE/L1C_T35TLL_A008341_20170126T091606/IMG_DATA/T35TLL_20170126T091231_B04.jp2:Not a TIFF file, bad magic number 0 (0x0)
ERROR 1: /home/roformon1/Workspace/MAJA/repWork/35TLL/35TLL/MAJA_1_0_S2AS2B_NATIF/in/S2A_MSIL1C_20170126T091231_N0204_R050_T35TLL_20170126T091606.SAFE/GRANULE/L1C_T35TLL_A008341_20170126T091606/IMG_DATA/T35TLL_20170126T091231_B05.jp2:Not a TIFF file, bad magic number 0 (0x0)
ERROR 1: /home/roformon1/Workspace/MAJA/repWork/35TLL/35TLL/MAJA_1_0_S2AS2B_NATIF/in/S2A_MSIL1C_20170126T091231_N0204_R050_T35TLL_20170126T091606.SAFE/GRANULE/L1C_T35TLL_A008341_20170126T091606/IMG_DATA/T35TLL_20170126T091231_B06.jp2:Not a TIFF file, bad magic number 0 (0x0)
ERROR 1: /home/roformon1/Workspace/MAJA/repWork/35TLL/35TLL/MAJA_1_0_S2AS2B_NATIF/in/S2A_MSIL1C_20170126T091231_N0204_R050_T35TLL_20170126T091606.SAFE/GRANULE/L1C_T35TLL_A008341_20170126T091606/IMG_DATA/T35TLL_20170126T091231_B07.jp2:Not a TIFF file, bad magic number 0 (0x0)
ERROR 1: /home/roformon1/Workspace/MAJA/repWork/35TLL/35TLL/MAJA_1_0_S2AS2B_NATIF/in/S2A_MSIL1C_20170126T091231_N0204_R050_T35TLL_20170126T091606.SAFE/GRANULE/L1C_T35TLL_A008341_20170126T091606/IMG_DATA/T35TLL_20170126T091231_B08.jp2:Not a TIFF file, bad magic number 0 (0x0)
ERROR 1: /home/roformon1/Workspace/MAJA/repWork/35TLL/35TLL/MAJA_1_0_S2AS2B_NATIF/in/S2A_MSIL1C_20170126T091231_N0204_R050_T35TLL_20170126T091606.SAFE/GRANULE/L1C_T35TLL_A008341_20170126T091606/IMG_DATA/T35TLL_20170126T091231_B8A.jp2:Not a TIFF file, bad magic number 0 (0x0)
ERROR 1: /home/roformon1/Workspace/MAJA/repWork/35TLL/35TLL/MAJA_1_0_S2AS2B_NATIF/in/S2A_MSIL1C_20170126T091231_N0204_R050_T35TLL_20170126T091606.SAFE/GRANULE/L1C_T35TLL_A008341_20170126T091606/IMG_DATA/T35TLL_20170126T091231_B09.jp2:Not a TIFF file, bad magic number 0 (0x0)
ERROR 1: /home/roformon1/Workspace/MAJA/repWork/35TLL/35TLL/MAJA_1_0_S2AS2B_NATIF/in/S2A_MSIL1C_20170126T091231_N0204_R050_T35TLL_20170126T091606.SAFE/GRANULE/L1C_T35TLL_A008341_20170126T091606/IMG_DATA/T35TLL_20170126T091231_B10.jp2:Not a TIFF file, bad magic number 0 (0x0)
ERROR 1: /home/roformon1/Workspace/MAJA/repWork/35TLL/35TLL/MAJA_1_0_S2AS2B_NATIF/in/S2A_MSIL1C_20170126T091231_N0204_R050_T35TLL_20170126T091606.SAFE/GRANULE/L1C_T35TLL_A008341_20170126T091606/IMG_DATA/T35TLL_20170126T091231_B11.jp2:Not a TIFF file, bad magic number 0 (0x0)
ERROR 1: /home/roformon1/Workspace/MAJA/repWork/35TLL/35TLL/MAJA_1_0_S2AS2B_NATIF/in/S2A_MSIL1C_20170126T091231_N0204_R050_T35TLL_20170126T091606.SAFE/GRANULE/L1C_T35TLL_A008341_20170126T091606/IMG_DATA/T35TLL_20170126T091231_B12.jp2:Not a TIFF file, bad magic number 0 (0x0)
2018-07-04T21:14:02.621284 localhost.localdomain maja-processing 01.00 [000000095907] [E] ******************************************************************************************************  [vnsMajaMainProcessor.cxx:main:128]
2018-07-04T21:14:02.796529 localhost.localdomain maja-processing 01.00 [000000095907] [E] ScientificProcessing: ITK Exception: itk::ERROR: PersistentStreamingMaskConditionalStatisticsVectorImageFilter(0x84bd270): Inputs do not occupy the same physical space! 
InputImage Origin: [3.0012000e+05, 5.0999200e+06], InputImage_1 Origin: [3.0012000e+05, 5.0998800e+06]
    Tolerance: 2.4000000e-04
 [itkImageToImageFilter.hxx:248]  [vnsMajaMainProcessor.cxx:main:128]
2018-07-04T21:14:02.848829 localhost.localdomain maja-processing 01.00 [000000095907] [E]   [vnsMajaMainProcessor.cxx:main:128]
2018-07-04T21:14:02.868060 localhost.localdomain maja-processing 01.00 [000000095907] [E] ******************************************************************************************************  [vnsMajaMainProcessor.cxx:main:128]

I hope this is what you where asking for...

Kind regards, Ignacio

olivierhagolle commented 6 years ago

Hi Ignacio, @bruno68 told me it might be related to an error in the generation of the DEM, and in the parameters toy entered in the 35TLL.txt file. The JP2 images, and DEM must be absolutely similar.

For intance, if you use gdalinfo with a 10m GDAL file, and with a 10m S2 JP2, you must get exactly the same corners and number of pixels. It it is not the case, you will have to change the coordinates in 35TLL.txt according to the UL and number of pixels returned by gdalinfo for the 10m image.

I think your file 35TLL.txt should therefore contain ;

proj=UTM35N EPSG_out=32635 chaine_proj=EPSG:32635 tx_min=0 ty_min=0 tx_max=0 ty_max=0 pas_x=109800 pas_y=109800 orig_x=300000 orig_y=5100000 marge=0

borlafgis commented 6 years ago

Hello Olivier, Sorry for my late answer, I have been stuck with some other stuff. I tried re-generating the DEM with the extent you suggested . Now I get the error:

PreProcessing: std::exception error: vector::_M_range_check [vnsMajaMainProcessor.cxx:main:127]

I am very sorry about my constant questions, but I do not know how to deal with these errors.

Thanks a lot, Ignacio

bruno68 commented 6 years ago

Hello Ignacio, We already met this issue. It may be related to files with the wrong extension in the DEM folder, maybe a file with extension .tif.aux.xml produced by the prepare_mnt script. Thanks for letting us know if this helped with the issue. Bruno

olivierhagolle commented 6 years ago

Bruno is right, it is an issue that we will correct in a next version. You have to remove all the .aux.xml files (generated by gdalinfo) in the DEM directory. Sorry for that and thanks for your persistence in trying to use MAJA ;) Best regards, Olivier

borlafgis commented 6 years ago

Hello to both, Olivier and Bruno

With this finishing touches it has been running from 6 in the morning. The log shows that it has gone over at least two images, although it has not produced anything in the output folder yet. So... I think is running now.

Thanks to both for your patience Ignacio

olivierhagolle commented 6 years ago

Thanks for letting us know ! Olivier

Cilence-lab commented 3 years ago

Hi, Can anyone help. I get the following errors:

Command: python Start_maja.py -f folders.txt -t T35JQN -d 2019-03-03 -e 2019-03-30

020-11-24 01:45:34,561 [INFO ] =============This is Start_Maja v4.2.0============== 2020-11-24 01:45:34,564 [INFO ] Detecting input products... 2020-11-24 01:45:34,566 [INFO ] 3 L1C product(s) detected for tile 35JQN in /home/cilence/Start_Maja/L1_Products/T35JQN 2020-11-24 01:45:34,566 [WARNI] No L2A products detected for tile 35JQN in /home/cilence/Start_Maja/L2_Products/35JQN 2020-11-24 01:45:34,567 [INFO ] Skipping CAMS file detection. 2020-11-24 01:45:34,567 [INFO ] Checking GIPP files 2020-11-24 01:45:34,567 [INFO ] Setting up GIPP folder: /home/cilence/Start_Maja/gipp_maja 2020-11-24 01:45:34,573 [INFO ] Searching for DTM 2020-11-24 01:45:34,573 [INFO ] Found DTM: /home/cilence/Start_Maja/start_maja_dem/S2__TEST_AUX_REFDE2_35JQN_1001.HDR 2020-11-24 01:45:34,578 [INFO ] GIPP Creation succeeded for SENTINEL2_NATIF 2020-11-24 01:45:34,578 [INFO ] Not enough L1 products available for a BACKWARD mode. Beginning with INIT... 2020-11-24 01:45:34,578 [INFO ] 3 workplan(s) successfully created: DATE | TILE | MODE | L1-PRODUCT | ADDITIONAL INFO 2019-03-03 07:48:21 | 35JQN | INIT | S2A_MSIL1C_20190303T074821_N0207_R135_T35JQN_20190303T112702.SAFE | Init mode - No previous L2 2019-03-18 07:46:39 | 35JQN | NOMINAL | S2B_MSIL1C_20190318T074639_N0207_R135_T35JQN_20190318T113212.SAFE | L2 from previous 2019-03-28 07:48:39 | 35JQN | NOMINAL | S2B_MSIL1C_20190328T074839_N0207_R135_T35JQN_20190328T114750.SAFE | L2 from previous Press Enter to continue...

2020-11-24 01:45:35,442 [INFO ] Beginning workplan execution. 2020-11-24 01:45:35,442 [INFO ] Executing workplan #1/3 2020-11-24T01:45:35.508183 cilence-VirtualBox maja-processing-3.3.5 3.3 [000000233450] [I] MAJA Software Version : 3.3.5 2020-11-24T01:45:35.511019 cilence-VirtualBox maja-processing-3.3.5 3.3 [000000233450] [E] vns::Data::ERROR: XMLFileHandler(0x901a80): The xml file </home/cilence/Start_Maja/start_maja_work/Start_maja_a85b5f852147588486cf2717f922bab1/maja_working_directory/maja-working-directory/MAJAUserConfigSystem.xml> is not conform with its schema </home/cilence/Maja-3.2/share/schemas/Maja/MAJAUserConfigSystem.xsd> !, Log of execution :Command line : xmllint --noout /home/cilence/Start_Maja/start_maja_work/Start_maja_a85b5f852147588486cf2717f922bab1/maja_working_directory/maja-working-directory/MAJAUserConfigSystem.xml --schema /home/cilence/Maja-3.2/share/schemas/Maja/MAJAUserConfigSystem.xsd .Log : /home/cilence/Start_Maja/start_maja_work/Start_maja_a85b5f852147588486cf2717f922bab1/maja_working_directory/maja-working-directory/MAJAUserConfigSystem.xml:40: element RAM: Schemas validity error : Element '{http://maja.fr}RAM': This element is not expected. Expected is ( {http://maja.fr}EnableL2ResolutionProcessing ). /home/cilence/Start_Maja/start_maja_work/Start_maja_a85b5f852147588486cf2717f922bab1/maja_working_directory/maja-working-directory/MAJAUserConfigSystem.xml fails to validate [vnsXMLFileHandler.cxx:CheckXmlWithXsd:190] 2020-11-24T01:45:35.511399 cilence-VirtualBox maja-processing-3.3.5 3.3 [000000233450] [E] ** [vnsMajaMainProcessor.cxx:main:73] 2020-11-24T01:45:35.511482 cilence-VirtualBox maja-processing-3.3.5 3.3 [000000233450] [E] Application handler initialization: vns::Data::ERROR: XMLFileHandler(0x901a80): The xml file </home/cilence/Start_Maja/start_maja_work/Start_maja_a85b5f852147588486cf2717f922bab1/maja_working_directory/maja-working-directory/MAJAUserConfigSystem.xml> is not conform with its schema </home/cilence/Maja-3.2/share/schemas/Maja/MAJAUserConfigSystem.xsd> !, Log of execution :Command line : xmllint --noout /home/cilence/Start_Maja/start_maja_work/Start_maja_a85b5f852147588486cf2717f922bab1/maja_working_directory/maja-working-directory/MAJAUserConfigSystem.xml --schema /home/cilence/Maja-3.2/share/schemas/Maja/MAJAUserConfigSystem.xsd .Log : /home/cilence/Start_Maja/start_maja_work/Start_maja_a85b5f852147588486cf2717f922bab1/maja_working_directory/maja-working-directory/MAJAUserConfigSystem.xml:40: element RAM: Schemas validity error : Element '{http://maja.fr}RAM': This element is not expected. Expected is ( {http://maja.fr}EnableL2ResolutionProcessing ). /home/cilence/Start_Maja/start_maja_work/Start_maja_a85b5f852147588486cf2717f922bab1/maja_working_directory/maja-working-directory/MAJAUserConfigSystem.xml fails to validate [vnsXMLFileHandler.cxx:190] [MAJA Data Exception] [vnsMajaMainProcessor.cxx:main:73] 2020-11-24T01:45:35.511649 cilence-VirtualBox maja-processing-3.3.5 3.3 [000000233450] [E] [vnsMajaMainProcessor.cxx:main:73] 2020-11-24T01:45:35.511767 cilence-VirtualBox maja-processing-3.3.5 3.3 [000000233450] [E] ** [vnsMajaMainProcessor.cxx:main:73] Traceback (most recent call last): File "Start_maja.py", line 562, in s.run() File "Start_maja.py", line 509, in run wp.execute(self.maja, self.dtm, self.gipp, self.userconf) File "/home/cilence/Start_Maja/Chain/Workplan.py", line 187, in execute return_code = self.launch_maja(maja, wdir=self.wdir, inputdir=self.input_dir, outdir=self.outdir, conf=conf) File "/home/cilence/Start_Maja/Chain/Workplan.py", line 170, in launch_maja return FileSystem.run_external_app(maja, args, logfile=logfile, skip_error=self.skip_errors) File "/home/cilence/Start_Maja/Common/FileSystem.py", line 188, in run_external_app raise subprocess.CalledProcessError(return_code, cmd) subprocess.CalledProcessError: Command '/home/cilence/Maja-3.2/bin/maja -w /home/cilence/Start_Maja/start_maja_work/Start_maja_a85b5f852147588486cf2717f922bab1/maja_working_directory --input /home/cilence/Start_Maja/start_maja_work/Start_maja_a85b5f852147588486cf2717f922bab1 --output /home/cilence/Start_Maja/L2_Products/35JQN --mode L2INIT -ucs /home/cilence/Start_Maja/userconf --TileId 35JQN --loglevel PROGRESS' returned non-zero exit status 133.