Open-EO / openeo-geopyspark-driver

OpenEO driver for GeoPySpark (Geotrellis)
Apache License 2.0
25 stars 4 forks source link

JobTracker requires application IDs #632 #638

Closed bossie closed 5 months ago

bossie commented 5 months ago

Preparing to read tracked jobs from EJR instead of ZK.

635 will currently fetch a lot of jobs from EJR, including those that were never actually started. This mimics the ZK implementation in a way (it will just get those in the /ongoing branch) but that one employs a user_limit to keep requests down; this uses a different strategy and if this thing works in ZK, we can just port it to EJR.

The rationale is that JobTracker requires an application ID in order to do something useful (= use this application ID to fetch the state of the underlying application and update the job status).