[Integration]Add VPC Flow Logs Getting-Started - Githubissues

opensearch-project / opensearch-catalog

The OpenSearch Catalog is designed to make it easier for developers and community to contribute, search and install artifacts like plugins, visualization dashboards, ingestion to visualization content packs (data pipeline configurations, normalization, ingestion, dashboards).

Apache License 2.0

21 stars 19 forks source link

[Integration]Add VPC Flow Logs Getting-Started #178

Open YANG-DB opened 4 months ago

YANG-DB commented 4 months ago

What is the integration resource ?

VPC - Flow Logs

What is the integration source protocol ? VPC Flow logs schema under Otel Protocol

Which agents would you use to ship this data ?

Flint S3 based ingestion process (Zero ETL)

Would you be using an ingestion pipeline ?

Flint Spark S3 Glue Based Ingestion

What are the integration assets ?

We will be adding the getting started tutorials and dashboards including the

Details instructions for logging VPC into S3
Connecting to Glue catalog
OpenSearch Schema creation
OpenSearch Index-Pattern creation

Do you have any additional context?

https://github.com/opensearch-project/opensearch-catalog/tree/main/integrations/observability/amazon_vpc_flow

dblock commented 3 months ago

[Catch All Triage - 1, 2, 3]