opensearch-project / index-management

🗃 Automate periodic data operations, such as deleting indices at a certain age or performing a rollover at a certain size
https://opensearch.org/docs/latest/im-plugin/index/
Apache License 2.0
52 stars 107 forks source link

[FEATURE] Enable additional logging for Index Transform #1133

Open sarthakaggarwal97 opened 3 months ago

sarthakaggarwal97 commented 3 months ago

Is your feature request related to a problem? This issue is to add logging to understand the processes under the transform job. Currently, there is no visibility to know what phase of the job is being executed and what queries are being made.

There are three phases in which the transform job is currently executed.

  1. Search Phase
  2. Compute Aggregations
  3. Index into Target Index

This issue will get more information around these phases

What solution would you like? Additional trace logging to have more visibility

dblock commented 2 weeks ago

Catch All Triage - 1 2 3 4 5