stripe-archive / mosql

MongoDB → PostgreSQL streaming replication
MIT License
1.63k stars 225 forks source link

Adding MySQL and Mongo slave functionality #37

Open smchugh opened 10 years ago

smchugh commented 10 years ago

Here is a patch to add in MySQL functionality along with a few other things we needed.

Changes:

Thanks for taking a look.

nelhage commented 10 years ago

Thanks for the patchset! I'm super busy right now, but I'll try to look at this in more detail by early next week at the latest.

smchugh commented 10 years ago

Thanks for taking a look at this. The Travis CI error seems to be from the fact that it's looking for 0.3.1 rather than 0.3.2. I'll change the version file to use 0.3.1 when I go in and remove the slaveOk commit

nelhage commented 10 years ago

I'm fine taking this PR if you fix the things I've mentioned. I'd ideally like to see the code factored out so we have backend-specific adapters that implement a common interface, but I'm happy to merge this for now without that.

goutamdan commented 10 years ago

During the initial import, the query for bulk copying always fails because of syntax errors caused by wrong quoting. The field names have double quotes and the values have no quotes at all. So this always falls back to the update and insert queries. This makes initial import extremely slow. Any plans to fix this?

smchugh commented 10 years ago

@goutamdan We ended up not using this tool, so the projected ended up dropped. I'd ideally like to pick it back up on my own time, but haven't had the chance. If you wanted to pick this up, I'd be more than glad to accept a PR into this branch.

CLAassistant commented 4 years ago

CLA assistant check
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.


Steve McHugh seems not to be a GitHub user. You need a GitHub account to be able to sign the CLA. If you have already a GitHub account, please add the email address used for this commit to your account.
You have signed the CLA already but the status is still pending? Let us recheck it.