WorldCereal / classification-docker

Docker image creation for classification
Apache License 2.0
1 stars 0 forks source link

Global summer1/summer2/winter production V3 - Incomplete collection 'TIR' after season filtering #87

Open romain-bdc opened 1 year ago

romain-bdc commented 1 year ago

During production V3 of summer2 products an issue occured on incomplete TIR data :

For 18MYS and 18MZT : Incomplete collection 'TIR': got a collection size of 1 which is less than the threshold of 2. For 40KEC : Incomplete collection 'TIR': got a collection size ofz 0 which is less than the threshold of 2 Tile id season Area Info Coment
18MYS summer2 Terra Indígena do Vale do Javari (Brasil) 18MYS_017.zip TIR data available from 10/2020 to 12/2020 and from 01/2021 to 09/2021
18MZT summer2 Terra Indígena do Vale do Javari (Brasil) 18MZT_082.zip TIR data available from 10/2020 to 12/2020 and from 01/2021 to 09/2021
40KEC summer1 Port Louis 40KEC_017.zip TIR data available from 05/2020 to 12/2020 and from 01/2021 to 10/2021
40KEC winter Port Louis 40KEC_017_winter.zip TIR data available from 05/2020 to 12/2020 and from 01/2021 to 10/2021
savmickael commented 1 year ago

@kvantricht these tiles have few L8 ARD but not in the requested season. When we build the csv we have L8 and you filter them in our code. Need to discuss where it is the best place to manage this case. In any case we need to switch off the irrigation map production.

kvantricht commented 1 year ago

@savmickael If you switch of irrigation and remove TIR from the collection (you already do this sometimes?), wouldn't it solve these cases automatically?

savmickael commented 1 year ago

A quick and dirty fix is to remove the TIR data from the bucket and the current code will manage this case.

But currently the CSV is not empty because we have computed the TIR ARD for the full cropland season. So we need a code which filter the csv according the season. We can reuse your check_collection code I think.