elastic / connectors

Source code for all Elastic connectors, developed by the Search team at Elastic, and home of our Python connector development framework
https://www.elastic.co/guide/en/enterprise-search/master/index.html
Other
58 stars 116 forks source link

Log error if sync has finished with an error #2645

Open artem-shelkovnikov opened 1 week ago

artem-shelkovnikov commented 1 week ago

Problem Description

Currently there is no way to see which error caused sync to finish - this does not get logged consistently. This information is displayed in UI, but we should also log the error that caused the sync to terminate in the end of the process.

Proposed Solution

Add a log line around https://github.com/elastic/connectors/blob/main/connectors/sync_job_runner.py#L394 that outputs the exception that caused this sync to finish.

Alternatives

Investigate a better place to log error