Use Connector APIs to update sync job stats - Githubissues

elastic / connectors

Source code for all Elastic connectors, developed by the Search team at Elastic, and home of our Python connector development framework

https://www.elastic.co/guide/en/enterprise-search/master/index.html

Other

58 stars 116 forks source link

Use Connector APIs to update sync job stats #2659

Closed jedrazb closed 2 days ago

jedrazb commented 3 days ago

Closes https://github.com/elastic/search-team/issues/7474

Use update stats api to update connector sync job ingestion stats.

Note we don't need to provide last_seen as server will update it automatically to current UTC timestamp.

This feature is behind a feature flag that is disabled by default.

Validation

added unit tests
tested e2e on all sync types

Pre-Review Checklist

[x] this PR does NOT contain credentials of any kind, such as API keys or username/passwords (double check config.yml.example)
[x] this PR has a meaningful title
[x] this PR links to all relevant github issues that it fixes or partially addresses
[x] this PR has a thorough description
[x] Covered the changes with automated tests
[x] Tested the changes locally
[x] Added a label for each target release version (example: v7.13.2, v7.14.0, v8.0.0)

github-actions[bot] commented 2 days ago

💔 Failed to create backport PR(s)

The backport operation could not be completed due to the following error: There are no branches to backport to. Aborting.

The backport PRs will be merged automatically after passing CI.

To backport manually run: backport --pr 2659 --autoMerge --autoMergeMethod squash