-
**Describe the bug**
If the routes for a sink fail, such as when the expression is invalid, the process worker running will stop running. This will lead to Data Prepper running without any process …
-
Hi all,
I'm not sure if I'm missing something or if I'm doing something wrong on my end.
In my current data prepper setup there are traces that are getting dropped/sent to the logs of data pre…
-
**Describe the bug**
We have noticed that failures writing to the OpenSearch sink may result in the `opensearch` sink failing to continue to write, even after the issue is resolved.
**To Reprodu…
-
**Describe the bug**
When the data prepper pipeline Opensearch Sink initialization fails, data prepper continuously retries to recreate Opensearch client and OpenSearchClientRefresher (refresh creden…
-
**Describe the bug**
add roles and users to opensearch
```yaml
"log_collector_prepper" : {
"reserved" : false,
"hidden" : false,
"cluster_permissions" : [
"cluster_monitor"
…
-
**Is your feature request related to a problem? Please describe.**
As a user of data prepper, I would like to be able to validate my pipeline configurations without having to start the entirety of da…
-
**Is your feature request related to a problem? Please describe.**
A clear and concise description of what the problem is. Ex. It would be nice to have [...]
- See https://github.com/opensearch-proj…
-
**Is your feature request related to a problem? Please describe.**
Currently our ETL job runs every 30 minutes and inserts a file into S3, triggering OpenSearch ingestion pipeline. Due to varying ETL…
-
**Is your feature request related to a problem? Please describe.**
Currently, Data Prepper pipelines only accept data from one input, I'd like to be able to bring in data from multiple inputs into a …
-
Date Processor in Data Prepper is unable to parse the date time given the below patterns defined in the pipeline YAML configuration.
Consider, `testMessage.log` has a line ```{"message": "Jul 30, …