LOG-1195: Add Openshift Ingest Plugin for ES

openshift / origin-aggregated-logging

139 stars 230 forks source link

LOG-1195: Add Openshift Ingest Plugin for ES #2122

Closed lukas-vlcek closed 3 years ago

lukas-vlcek commented 3 years ago

Description

Configure Elasticsearch to install Openshift Ingest Plugin.

/cc @ewolinetz /assign @jcantrill

Links

JIRA: https://issues.redhat.com/browse/LOG-1195

lukas-vlcek commented 3 years ago

/retest

lukas-vlcek commented 3 years ago

/retest

lukas-vlcek commented 3 years ago

@jcantrill @ewolinetz I added default pipeline definition and initialization on ES startup. Also I defined the default pipeline in appropriate index templates. Please have a look again.

Also notice change wrt the initialization process:

0100 is for ingest pipeline initialization (they need to happen before index templates are pushed in)
0200 is for index templates initialization now due to ^^

Q: Please let me know if I need to add the new folder ingest_pipelines on this line here: https://github.com/openshift/origin-aggregated-logging/blob/ddbb5d0b30a85d6252cb56d0dd7610c51108bbfb/elasticsearch/install.sh#L52

ewolinetz commented 3 years ago

Q: Please let me know if I need to add the new folder ingest_pipelines on this line here:

we shouldn't need to because we aren't updating the file at all. no need to do writes there.

lukas-vlcek commented 3 years ago

/test cluster-logging-operator-e2e

ewolinetz commented 3 years ago

@lukas-vlcek can we also fix the run.sh file to properly pick up the log4j2.properties file?

lukas-vlcek commented 3 years ago

@ewolinetz I think we can (though I would prefer separate PR).

vimalk78 commented 3 years ago

/retest

vimalk78 commented 3 years ago

/retest

vimalk78 commented 3 years ago

/retest

vimalk78 commented 3 years ago

/retest

vimalk78 commented 3 years ago

/retest

vimalk78 commented 3 years ago

/retest

lukas-vlcek commented 3 years ago

/test cluster-logging-operator-e2e

jcantrill commented 3 years ago

/approve

jcantrill commented 3 years ago

/hold cancel

ewolinetz commented 3 years ago

/lgtm

openshift-ci[bot] commented 3 years ago

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: ewolinetz, jcantrill, lukas-vlcek

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files: - ~~[OWNERS](https://github.com/openshift/origin-aggregated-logging/blob/master/OWNERS)~~ [ewolinetz,jcantrill] Approvers can indicate their approval by writing `/approve` in a comment Approvers can cancel approval by writing `/approve cancel` in a comment

lukas-vlcek commented 3 years ago

/test cluster-logging-operator-e2e

openshift-bot commented 3 years ago

/retest

Please review the full test history for this PR and help us cut down flakes.

openshift-bot commented 3 years ago

/retest

Please review the full test history for this PR and help us cut down flakes.

openshift-bot commented 3 years ago

/retest

Please review the full test history for this PR and help us cut down flakes.

openshift-bot commented 3 years ago

/retest

Please review the full test history for this PR and help us cut down flakes.