search

CNES / MAJA

Level-2A processor used for atmospheric correction and cloud-detection. The active repository is the one below, this one is kept to leave access to the older issues.
https://gitlab.orfeo-toolbox.org/maja/maja
Apache License 2.0
137 stars 25 forks source link

SRTM unavailable #27

Closed daviddemeij closed 4 years ago

daviddemeij commented 4 years ago

Hi there,

I am trying to run Maja on an area where no SRTM or SBWD data seems to be available (in Finland). Is it still possible to use the tool?

I tried running the program and I get the following error:

2019-07-25T10:56:26.906582 ip-172-31-46-119 maja-processing-3.3.0 3.3 [000000004774] [P] -----------------------------------------------------------------------------------------------
2019-07-25T10:56:26.906725 ip-172-31-46-119 maja-processing-3.3.0 3.3 [000000004774] [P] Starting L2Processor::PreProcessing() ...
2019-07-25T10:56:26.907257 ip-172-31-46-119 maja-processing-3.3.0 3.3 [000000004774] [I] List of the 2 satellite(s) activated :
2019-07-25T10:56:26.907774 ip-172-31-46-119 maja-processing-3.3.0 3.3 [000000004774] [I]  - SENTINEL-2A ('common' satellite SENTINEL-2_ and plugin SENTINEL2_TM)
2019-07-25T10:56:26.908303 ip-172-31-46-119 maja-processing-3.3.0 3.3 [000000004774] [I]  - SENTINEL-2B ('common' satellite SENTINEL-2_ and plugin SENTINEL2_TM)
2019-07-25T10:56:26.908801 ip-172-31-46-119 maja-processing-3.3.0 3.3 [000000004774] [I] Starting reading and checking input data common for each plugin activated...
2019-07-25T10:56:26.909387 ip-172-31-46-119 maja-processing-3.3.0 3.3 [000000004774] [I] According to the input data, there is(are) 1 plugin(s) activated:
2019-07-25T10:56:26.909980 ip-172-31-46-119 maja-processing-3.3.0 3.3 [000000004774] [I]  - SENTINEL2_TM
2019-07-25T10:56:26.910640 ip-172-31-46-119 maja-processing-3.3.0 3.3 [000000004774] [I]  - SENTINEL2_TM
2019-07-25T10:56:27.178671 ip-172-31-46-119 maja-processing-3.3.0 3.3 [000000004774] [E] vns::Data::ERROR: DataApplicationHandler(0xc667f0): In the input directory, there is no GIPP input data matching with the 'AUX_REFDE2' File_Type pattern!  [vnsDataApplicationHandler.cxx:GetListOfGippFilenames:1699]
2019-07-25T10:56:27.183059 ip-172-31-46-119 maja-processing-3.3.0 3.3 [000000004774] [E] ******************************************************************************************************  [vnsMajaMainProcessor.cxx:main:129]
2019-07-25T10:56:27.183178 ip-172-31-46-119 maja-processing-3.3.0 3.3 [000000004774] [E] PreProcessing: vns::Data::ERROR: DataApplicationHandler(0xc667f0): In the input directory, there is no GIPP input data matching with the 'AUX_REFDE2' File_Type pattern! [vnsDataApplicationHandler.cxx:1699] [MAJA Data Exception]  [vnsMajaMainProcessor.cxx:main:129]
2019-07-25T10:56:27.183780 ip-172-31-46-119 maja-processing-3.3.0 3.3 [000000004774] [E]   [vnsMajaMainProcessor.cxx:main:129]
2019-07-25T10:56:27.184357 ip-172-31-46-119 maja-processing-3.3.0 3.3 [000000004774] [E] ******************************************************************************************************  [vnsMajaMainProcessor.cxx:main:129]
daviddemeij commented 4 years ago

Is it perhaps possible to use another DTM source?

jerome-colin commented 4 years ago

Dear David, I should be possible to use another DTM, although it would probably require to write a dedicated script to have it in the right format. I'll leave the answer to Olivier who will be back to the office next week. Thanks, Jerome

EkicierNico commented 4 years ago

Hello, I have an error at the DTM creation step, because of non-availability of SRTM.

I'm testing Maja on T29SMC tile, and here is one of output of window : Need to download the file srtm_34_05.zip

However, this file does not exist in this website : http://srtm.csi.cgiar.org/srtmdata/.

Maybe can we get 30x30 degree ?

Thank you for your feedback. Nicolas

olivierhagolle commented 4 years ago

Hi David, It is of course possible to use another DEM, as long as the input format of MAJA is respected. But we can't provide a converter, resampler for any DEM input. So you can use DTMCreation to have an example of how to transfrom your own DEM into the format needded for MAJA (with the computations of slopes and aspect, and resampling at full and coarse resolutions). Olivier

Mholst03 commented 4 years ago

Hi @daviddemeij ,

For my internship, I am comparing processing chains to find the best cloud mask. I would like to run MAJA on Finland. Did you find a way to do it without SRTM and SWBD data?

Best regards, Marion

daviddemeij commented 4 years ago

Hi Marion, we haven't tried this yet but I think it's possible to run by finding another SRTM source of Finland and giving it the same filename as Maja expects.

olivierhagolle commented 4 years ago

Hi Marion, we intend to add in our tools the possibility to use another DEM so that it works above 60 degrees, but it will take a few months, as it will be the job of a new comer in our team, who did not start yet.

Ans just for your complete information concerning cloud masks, we did such a comparison for 32 images:

Baetens, L.; Desjardins, C.; Hagolle, O. Validation of Copernicus Sentinel-2 Cloud Masks Obtained from MAJA, Sen2Cor, and FMask Processors Using Reference Cloud Masks Generated with a Supervised Active Learning Procedure. Remote Sens. 2019, 11, 433. https://www.mdpi.com/2072-4292/11/4/433

Best regards, Olivier

rohitshetty commented 3 years ago

Hi, @olivierhagolle Sorry for commenting on a closed thread. If the support of using another DEM is not implemented yet / hasn't started yet, is there any way I can help? Thank you,