airbytehq / write-for-the-community

Contribute and collaborate on educational content for the Airbyte Community.
MIT License
42 stars 8 forks source link

Replicate mysql data from one server to another using s3 #169

Open OggyMishra opened 1 year ago

OggyMishra commented 1 year ago

I want to understand if airbyte supports data migration from 1 mysql server to another via s3. Our use case is that we have 1 kubernetes cluster which process and creates the data and write it to mysql. We have few enterprise clients which don't allow accessing db from their cluster. As a solution we thought about deploying a service on the enterprise side which will poll from s3 and writes to mysql on enterprise cluster.

We are thinking airbyte can help us in this particular use case where we can create one pipeline from our cluster and write it to s3, from there will write another pipeline at the enterprise side which will read from s3 and write to mysql