Standalone Harvest client application providing the functionality for capturing and indexing product metadata into the PDS Registry system (https://github.com/nasa-pds/registry).
We are interested in this technical option as we could ourselves implement something similar as servers (to download from S3 or from the PDS Search API) if costs requires it.
💡 Description
See if rate indicators possibly provided in the OpenSearch API response (as described in https://www.elastic.co/guide/en/cloud/current/ec-api-rate-limiting.html), can help to better manage the throttling before it occurs.
We are interested in this technical option as we could ourselves implement something similar as servers (to download from S3 or from the PDS Search API) if costs requires it.
⚔️ Parent Epic / Related Tickets
No response