search

erezsh / reladiff

High-performance diffing of large datasets across databases
https://reladiff.readthedocs.io/en/latest/index.html#
Other
356 stars 9 forks source link

Add support for MongoDB #13

Open dror-g opened 3 months ago

dror-g commented 3 months ago

Hi, I'd suggest supporting MongoDB / DocumentDB as they are ~unfortunately~ very popular with developers.

Since it's possible to specify index & columns, it's possible to cross the non-relational divide.

There's a need to use something other than Sqeleton, as it does not support Mongo (and was archived, as well as the new project that took ownership, so maybe seeking alternatives is in the stars regardless..)

Cheers!

erezsh commented 3 months ago

Hi, Sqeleton is alive and well here: https://github.com/erezsh/sqeleton

It's true that it doesn't support Mongo, but it will if anyone contributes it.

Since it's possible to specify index & columns, it's possible to cross the non-relational divide.

I'm not very familiar with MongoDB's performance and inner-workings, but for it to work well with the cross-db diff, it should support -

For the same-db diff, it needs a fast-enough outer join.