search

unity-sds / unity-sps-prototype

Apache License 2.0
2 stars 7 forks source link

[New Feature]: Query the Jobs Metadata by arbitrary labels #211

Closed LucaCinquini closed 1 year ago

LucaCinquini commented 1 year ago

Allow clients to query the Jobs Database by arbitrary labels. Support offset and limit as query parameters for pagination. Must first establish consensus within Unity about how the query parameters should be supplied in the request.

LucaCinquini commented 1 year ago

Question: should querying with labels be implemented as an extension to the WPS-T API, or should we simply (or at first) expose the Jobs database Elasticsearch endpoint?

LucaCinquini commented 1 year ago

It was decided during the 23.3 PI to use Elasticsearch to query the Jobs Database. The Elasticsearch API needs to be exposed and added as a parameter in SSM. Ryan/Drew please work on implementing these last 2 items.

LucaCinquini commented 1 year ago

We decided that the Elasticsearch URL of the Jobs Database needs to be exposed both as an SSM parameter, and as an env variable available in the Verdi worker Docker container.

LucaCinquini commented 1 year ago

For each deployment, the jobs database URL can be retrieved from SSM using this key: /unity/sps/{deployment_name}/jobsDb/url Closing the ticket.