search

Open-EO / openeo-geopyspark-driver

OpenEO driver for GeoPySpark (Geotrellis)
Apache License 2.0
26 stars 4 forks source link

python-memory should also have a maximum #850

Closed EmileSonneveld closed 3 weeks ago

EmileSonneveld commented 1 month ago

This job should throw an error early on: j-240827102bf84bf798aebf2193155558 job_options:

{
  "executor-memory": "10g",
  "python-memory": "10g",
  "udf-dependency-archives": [...]
}

Probably need to update this code: https://github.com/Open-EO/openeo-geopyspark-driver/blob/8c0023593d7578ef925f0072d745ce00d6515203/openeogeotrellis/backend.py#L1762

cc @pvbouwel

JeroenVerstraelen commented 4 weeks ago

Waiting for code review