Is your feature request related to a problem? Please describe.
Production setups generally use a streaming loader, and have ETL in separate pipelines. By implementing kafka loaders and persist, pipelines can be connected distributedly.
Describe the solution you'd like
A kafka loader and a kafka storage.
Is your feature request related to a problem? Please describe. Production setups generally use a streaming loader, and have ETL in separate pipelines. By implementing kafka loaders and persist, pipelines can be connected distributedly.
Describe the solution you'd like A kafka loader and a kafka storage.