search

gbif / portal16

GBIF.org website
https://www.gbif.org
Apache License 2.0
24 stars 15 forks source link

Update health checks etc to use the Stackable environment #1936

Open MattBlissett opened 1 month ago

MattBlissett commented 1 month ago

The dev2/uat2 configuration refers to Oozie and YARN, which won't exist in the new cluster.

MortenHofft commented 1 month ago

Perhaps this is a perfect occasion to remove the health checks from portal16? to use some other API? Either way, when is this due?

MattBlissett commented 1 month ago

With admin authentication, https://api.gbif.org/v1/occurrence/download?status=PREPARING&status=RUNNING gives the number of running downloads.

For 'ingestion' I think add the sum of the counts of http://api.gbif.org/v1/dataset/process/running and https://api.gbif.org/v1/pipelines/history/process/running

That can apply in current prod too, and the config needing Oozie and YARN removed.

MortenHofft commented 3 weeks ago

Ingestion counts have been updated, but download counts is blocked by https://github.com/gbif/registry/issues/588