opensearch-project / data-prepper

Data Prepper is a component of the OpenSearch project that accepts, filters, transforms, enriches, and routes data at scale.
https://opensearch.org/docs/latest/clients/data-prepper/index/
Apache License 2.0
262 stars 195 forks source link

Feature(s) Request: More source plugins #4392

Open williejay2017 opened 6 months ago

williejay2017 commented 6 months ago

Is your feature request related to a problem? Please describe. Currently my team uses logstash for our log shipping solution. In its current form (OSS version), it's muddled with CVE's and I would like to swich to data-prepper but I have noticed that its lacking in some of the essential plugins we use. I am wondering can we add these? Redis , Apache Pulsar, Azure event Hubs sources.

Describe the solution you'd like Redis, Apache Pulsar, Azure Event Hubs source pluggin support

Describe alternatives you've considered (Optional) FluentD

Additional context none

sharraj commented 6 months ago

We welcome openSource contributions to help us build these !. We will provide all needed support for design, code reviews.