Closed andrejvanderzee closed 1 year ago
Related to #151
It looks like I have misunderstood the index aliases. The output plugin should be configured like this:
opensearch {
auth_type => {
type => "aws_iam"
region => "${AWS_REGION}"
role_arn => "${AWS_ROLE_ARN}"
web_identity_token_file => "${AWS_WEB_IDENTITY_TOKEN_FILE}"
}
hosts => ["https://some.domain.com:443"]
index => "logs"
manage_template => false
}
Is your feature request related to a problem? Please describe. Opensearch supports automatic rollover of indices based on conditions such as data size. When Opensearch rolls over it creates a new index, but the output plugin keeps writing to the first index:
In the above example
logs-000001
keeps growing andlogs-000002
stays empty.Describe the solution you'd like After Opensearch rolls the index, the output plugin should write to new index
logs-000002
.Additional context This is the output plugin config:
It looks like the elasticsearch output plugin does support this via enabling ILM: https://www.elastic.co/guide/en/logstash/current/plugins-outputs-elasticsearch.html#plugins-outputs-elasticsearch-ilm