search

opensearch-project / OpenSearch-Dashboards

📊 Open source visualization dashboards for OpenSearch.
https://opensearch.org/docs/latest/dashboards/index/
Apache License 2.0
1.61k stars 826 forks source link

How to integrate Cloudwatch logs into Opensearch Dashboards #6854

Open Bhukyapramod opened 1 month ago

Bhukyapramod commented 1 month ago

Is your feature request related to a problem? Please describe.

A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]

Describe the solution you'd like

A clear and concise description of what you want to happen.

Describe alternatives you've considered

A clear and concise description of any alternative solutions or features you've considered.

Additional context

Add any other context or screenshots about the feature request here.

Hailong-am commented 1 month ago

First you need index the data into OpenSearch cluster, here found two approaches,

  1. Stream Logs from CloudWatch to OpenSearch Using AWS Kinesis. [1]

  2. Export cloudWatch logs to S3 and OpenSearch integrate with S3. [2][3]

[1] https://blog.axiomio.com/how-to-stream-logs-from-cloudwatch-to-opensearch-using-aws-kinesis-910569d3213e [2] https://docs.aws.amazon.com/AmazonCloudWatch/latest/logs/S3ExportTasksConsole.html [3] https://opensearch.org/docs/latest/dashboards/management/query-data-source/

BionIT commented 1 month ago

@Hailong-am Thanks for helping! Just assign you the task, and please feel free to correct if any.

@Bhukyapramod Does it answer your question?