-
Hi all,
I'm not sure if I'm missing something or if I'm doing something wrong on my end.
In my current data prepper setup there are traces that are getting dropped/sent to the logs of data pre…
-
### Search before asking
- [X] I searched the [issues](https://github.com/IBM/data-prep-lab/issues) and found no similar issues.
### Component
Tools/ingest2parquet
### What happened + What you ex…
sujee updated
3 weeks ago
-
**Is your feature request related to a problem? Please describe.**
As a user of data prepper, I would like to be able to validate my pipeline configurations without having to start the entirety of da…
-
### Required prerequisites
- [x] Consult the [security policy](https://github.com/NVIDIA/cuda-quantum/security/policy). If reporting a security vulnerability, do not report the bug using this form. U…
-
This will always contain the most up-to-date draft of the pipeline.
```mermaid
flowchart TD
prep_forecast["Prepare Forecast Data(Python using Polars)"]
prep_retro["Prepare Retro Data(Pytho…
-
@mwinokan and @phraenquex discussed that the fluid data formats for XCA, loader, and f/e are causing headaches for users and those helping to debug alignments.
The following solution is proposed:
…
-
**Is your feature request related to a problem? Please describe.**
Currently, Data Prepper pipelines only accept data from one input, I'd like to be able to bring in data from multiple inputs into a …
-
### Search before asking
- [X] I searched the [issues](https://github.com/IBM/data-prep-lab/issues) and found no similar issues.
### Component
Transforms/universal/doc_id
### What happen…
-
### Description of Issue
When rendering with any hydra delegate, like storm or your favorite hydra delegate, it would be wise -- given the non-negligible amount of time that it takes for rendering …
-
**Is your feature request related to a problem? Please describe.**
Currently our ETL job runs every 30 minutes and inserts a file into S3, triggering OpenSearch ingestion pipeline. Due to varying ETL…