(It may also be one of the lines in its vicinity. We could find out for sure by making the try/except clause more granular, but searching the internet for the error message points to this one.)
We need to figure out how to properly store arrays in parquet.
✌🏽 Expected behaviour
Data should be stored in an accessible format.
🥇 Definition of done
[ ] Convert calibrated image data to a format that can be stored using PyArrow
🐛 Description
When trying to store the calibrated image, the following error occurs:
It is a little unclear where in the code this occurs, but probably this line is the culprit:
https://github.com/innosat-mats/MATS-L1-processing/blob/7ad0af559f617143f78086d42e349aafb51a7bce/l1b_lambda/level1b/handlers/level1b.py#L123
(It may also be one of the lines in its vicinity. We could find out for sure by making the
try/exceptclause more granular, but searching the internet for the error message points to this one.)We need to figure out how to properly store arrays in parquet.
✌🏽 Expected behaviour
Data should be stored in an accessible format.
🥇 Definition of done
PyArrow