-
i tried run the "Streaming ETL pipelines in Python with Airbyte and Pathway"
and for many sources and i kept getting the folllowing error :
Traceback (most recent call last):
File "/home/hisha…
-
Hey everyone,
I have 2 questions:
Is it possible to establish a connection directly between my self-hosted unstructured API and S3 via a connector ? The goal would be to request the API with s3 url i…
-
**Is your feature request related to a problem? Please describe.**
Production setups generally use a streaming loader, and have ETL in separate pipelines. By implementing kafka loaders and persist, pi…
-
### Is your feature request related to a problem? Please describe.
No. It's a common senario, we use flink as a streaming processor to do ETL jobs saving data to Hive.
### Describe the solution you'…
-
Hi!
I am trying to execute the meds_etl_omop command to convert my OMOP dataset into MEDS but I'm getting the following error
```
Generating metadata from OMOP `concept` table
1it [00:06, 6.49s…
-
Hi,
Is there a way to deploy pathway airbyte streaming ETL microservice to Google cloud run? If yes, how to go about it?
thanks.
-
Being able to select pyarrow tables without copying, as well as accessing results as pyarrow tables without copying would be massively beneficial to building low-latency ETL pipelines and other data p…
-
Hi! Thank's for your tools compilation
I'd like to ask this question:
I've downloaded snapshot (slot №282991330) 60G size;
I've built solana-snapshot-etl bin and used it like this:
`./target/rel…
-
### Search before asking
- [X] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement.
### Descripti…
-
The dbms service is getting OOMurdered during ETL query. #36
Likely due to flattening in query. Should move to streaming results. https://github.com/cisco-ie/tdm/blob/05eb9c91ddefc8dfa21c919bec880…