opensearch-project / data-prepper

OpenSearch Data Prepper is a component of the OpenSearch project that accepts, filters, transforms, enriches, and routes data at scale.
https://opensearch.org/docs/latest/clients/data-prepper/index/
Apache License 2.0
267 stars 206 forks source link

Support SNS HTTPS as a Source #1083

Open dlvenable opened 2 years ago

dlvenable commented 2 years ago

Provide an SNS Source which can subscribe to an SNS topic (or use an existing subscription) to receive SNS notifications over HTTP/S.

This will be similar to the existing HTTP source plugin. However, it should also support auto confirmation of subscription requests. When an expected topic names a request, visit the SubscribeURL per the SNS protocol.

This can support auto-subscription either by a list of topics or using a topic name pattern.

Provide two options for topic auto-confirmation:

Provide configuration options just like http source:

sb2k16 commented 2 months ago

I would be interested in working on this functionality.