New Source: Redis - Githubissues

airbytehq / airbyte

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.

https://airbyte.com

Other

16.27k stars 4.15k forks source link

New Source: Redis #20786

Closed mannharleen closed 8 months ago

mannharleen commented 1 year ago

Tell us about the new connector you’d like to have

Which source and which destination?
Do you need a specific version of the underlying data source e.g: you specifically need support for an older version of the API or DB?

Redis source. I am particularly interested in redis stream but I believe other types will also be valuable.

Describe the context around this new connector

Why do you need this integration? How does your team intend to use the data? This helps us understand the use case.
How often do you want to run syncs?
If this is an API source connector, which entities/endpoints do you need supported?
If the connector is for a paid service, can we name you as a mutual user when we subscribe for an account? Which company should we name?

Redis (stream) data needs to be synced to a) warehouse b) kafak for analysis.

Describe the alternative you are considering or using

What are you considering doing if you don’t have this integration through Airbyte?

If redis streams source is not available, I might have to use an alternative tool like Benthos

Are you willing to submit a PR?

Sorry I wish I could but I am not proficient in python.

marcosmarxm commented 1 year ago

Adding this to team/db-dw-sources because Redis has JDBC driver.