Errors when pre-processing a workplan from Brazil

[agrosu1978]

Following error appeared for 474 products found in workplan 29110_c728b264_20220311.txt. The list of the erroneous products may be found in brazil_l8_error_list

[2022-03-15 18:35:13,789] [world-cereal] [ERROR ] Errors found in the output from command: ewoc_generate_l8_ard -v --prod-id BRAZIL/c728b264-5c97-4f4c-81fe-1500d4c4dfbd_44149_20220315032506 --only-tir prd_ids 21HYB LC09_L2SP_223084_20211216_20220121_02_T1 LE07_L2SP_223084_20211216_20220111_02_T1
[2022-03-15 18:35:13,790] [world-cereal] [ERROR ] /opt/ewoc_l8_venv/lib/python3.8/site-packages/eotile/eotiles/get_bb_from_tile_id.py:87: FutureWarning: The frame.append method is deprecated and will be removed from pandas in a future version. Use pandas.concat instead.
  output = output.append(tile)
Traceback (most recent call last):
  File "/opt/ewoc_l8_venv/bin/ewoc_generate_l8_ard", line 8, in <module>
    sys.exit(run())
  File "/opt/ewoc_l8_venv/lib/python3.8/site-packages/ewoc_l8/cli.py", line 239, in run
    main(sys.argv[1:])
  File "/opt/ewoc_l8_venv/lib/python3.8/site-packages/ewoc_l8/cli.py", line 215, in main
    run_id(args.l8c2l2_prd_ids,
  File "/opt/ewoc_l8_venv/lib/python3.8/site-packages/ewoc_l8/cli.py", line 92, in run_id
    process_group(
  File "/opt/ewoc_l8_venv/lib/python3.8/site-packages/ewoc_l8/l8_process.py", line 228, in process_group
    up_count, up_size, upload_path, bucket_name = process_group_band(
  File "/opt/ewoc_l8_venv/lib/python3.8/site-packages/ewoc_l8/l8_process.py", line 72, in process_group_band
    prd_date, __unused = get_band_key(band_num, prd_id)
  File "/opt/ewoc_l8_venv/lib/python3.8/site-packages/ewoc_l8/l8_process.py", line 286, in get_band_key
    return L8C2PrdIdInfo(prd_id).acquisition_date, key
  File "/opt/ewoc_l8_venv/lib/python3.8/site-packages/ewoc_dag/eo_prd_id/l8_prd_id.py", line 70, in __init__
    self.platform_id = elt_prd_id[0][3:4]
  File "/opt/ewoc_l8_venv/lib/python3.8/site-packages/ewoc_dag/eo_prd_id/l8_prd_id.py", line 92, in platform_id
    raise ValueError("Platform id is not possible!")
ValueError: Platform id is not possible!

29110_c728b264_20220311.txt

brazil_l8_error_list.txt

[abricier-cs]

Looks like the workplan generator is including LE07 / LC09 products. These must be filtered out at the WP level. On the other hand, removing the current "false" entry from the database would also clear the DB from these wrong entries.

[abricier-cs]

Even stranger, some entries containing L8 and L9/7, it looks like containing L9/7 is not necessarily inducing an error.

[abricier-cs]

Will be fixed in future WP versions: https://github.com/WorldCereal/ewoc_work_plan/pull/86