Failed Initialization of Opensearch Sink

[iqsh]

I am made two files, docker-compose.yml file with following description
version: '3' services: data-prepper: container_name: data-prepper image: opensearchproject/data-prepper:latest volumes:

• ./log_pipeline.yaml:/usr/share/data-prepper/pipelines/pipelines.yaml ports:
• 2021:2021 networks:
• opensearch-net networks: opensearch-net:

and log_pipelines.yaml with following description log-pipeline: source: http: ssl: false processor:

• grok: match: log: [ "%{COMMONAPACHELOG}" ] sink:
• opensearch: hosts: [ "https://opensearch.stack.com:9200" ] insecure: true username: admin password: admin index: nginx_logs

upon running docker compose file, the container is running but when i check it logs, having following problem

2023-12-06T07:13:10,583 [Thread-2] INFO org.opensearch.dataprepper.plugins.sink.opensearch.OpenSearchSink - Initializing OpenSearch sink 2023-12-06T07:13:10,583 [Thread-2] INFO org.opensearch.dataprepper.plugins.sink.opensearch.ConnectionConfiguration - Using the username provided in the config. 2023-12-06T07:13:10,583 [Thread-2] INFO org.opensearch.dataprepper.plugins.sink.opensearch.ConnectionConfiguration - Using the trust all strategy 2023-12-06T07:13:10,587 [Thread-2] WARN org.opensearch.dataprepper.plugins.sink.opensearch.OpenSearchSink - Failed to initialize OpenSearch sink, retrying: opensearch.stack.com 2023-12-06T07:13:11,582 [log-pipeline-sink-worker-2-thread-1] INFO org.opensearch.dataprepper.pipeline.Pipeline - Pipeline [log-pipeline] - sink is not ready for execution, retrying 2023-12-06T07:13:11,582 [log-pipeline-sink-worker-2-thread-1] INFO org.opensearch.dataprepper.plugins.sink.opensearch.OpenSearchSink - Initializing OpenSearch sink 2023-12-06T07:13:11,582 [log-pipeline-sink-worker-2-thread-1] INFO org.opensearch.dataprepper.plugins.sink.opensearch.ConnectionConfiguration - Using the username provided in the config. 2023-12-06T07:13:11,582 [log-pipeline-sink-worker-2-thread-1] INFO org.opensearch.dataprepper.plugins.sink.opensearch.ConnectionConfiguration - Using the trust all strategy 2023-12-06T07:13:11,587 [log-pipeline-sink-worker-2-thread-1] WARN org.opensearch.dataprepper.plugins.sink.opensearch.OpenSearchSink - Failed to initialize OpenSearch sink, retrying: opensearch.stack.com

i am using latest version for pulling image, is this causing an error

[dlvenable]

@iqsh , Can you include the stack trace for the error?

[jayeshjeh]

@iqsh try with the updated code.