gbif / pipelines

Pipelines for data processing (GBIF and LivingAtlases)
Apache License 2.0
40 stars 28 forks source link

EVENTS_INTERPRETED_TO_INDEX: Test the geo_shape data before indexing the field #1081

Open muttcg opened 4 months ago

muttcg commented 4 months ago

https://registry.gbif.org/dataset/b86fe411-8e62-4cd0-aab2-914d75401598/ingestion-history

Document id f92b427d13994d78e56ab1a834948dbdf4a19102: failed to parse field [derivedMetadata.wktConvexHull] of type [geo_shape] (mapper_parsing_exception)
Caused by: Unable to Tessellate shape [[-57.68737179894337, 180.0] [-41.33640394617278, 180.0] [-40.487624, 75.524812] [-40.276267, 93.380776] [-40.286639, 94.288232] [-41.096283, 162.67027] [-55.586734, 179.764054] [-67.465046, 36.441011] [-67.521718, 34.630594] [-57.68737179894337, 180.0] ]. Possible malformed shape detected. (illegal_argument_exception)
    at org.apache.beam.runners.spark.SparkPipelineResult.beamExceptionFrom(SparkPipelineResult.java:71)