brazil-data-cube / compare-cloud-masks

Comparison of Cloud Cover Detection Algorithms for Land Use - Classification of the Amazon Tropical Forests
1 stars 2 forks source link

Bug in code used to produce s2cloudless results #2

Open DomagojKorais opened 3 years ago

DomagojKorais commented 3 years ago

There is a bug in the code used to produce s2cloudless results. The problem is that the order of the bands given as input to the model is not defined.

The bug originates here. The os documentation states that the output of listdir is "in arbitrary order". Using bands in the wrong order leads to poor model performance.

I did a test on the left lower corner of tile T21LXH, image from March 28, 2017 and obtained the following results using the same parameters that you have published: correct bands order published cloud mask (from Figure 4.c) reference area (from Figure 4.a)
image image image

As you can see the results are totally different, so published results should be corrected once that the above issue is resolved. Additionally default threshold value is 0.4, and not 0.7 as stated in the paper: image

albhasan commented 3 years ago

Dear @DomagojKorais,

thanks for helping us improving our code. We are reviewing this issue and as soon as we have a result, we will inform you.

Best regards,

DomagojKorais commented 3 years ago

Dear @albhasan, is there any news regarding the results obtained using the fixed code? I am really curious to see the difference. Thanks.

albhasan commented 3 years ago

Good morning,

yes, there is. We recomputed the s2cloudless mask and we are preparing a manuscript updating the results. The preliminary results are displayed in the table below.

Bests,

image

DomagojKorais commented 2 years ago

Nice to see the improvements, thanks!