Qovery / Replibyte

Seed your development database with real data ⚡️
https://www.replibyte.com
GNU General Public License v3.0
4.15k stars 127 forks source link

Feature Request: Add ability to ignore including certain tables in the dump or option to auto-anonymize all columns in a table except those specified #225

Open patrick-grow-therapy opened 2 years ago

patrick-grow-therapy commented 2 years ago

I have certain tables in our production database that aren't necessary for local development, or would be risky attempting to anonymize given the chance for a leak. Is there a current way to ignore certain tables or anonymize all the columns within specific tables?

SnathanP commented 2 years ago

Hello @patrick-grow-therapy , i've been looking for the same feature. It seems tables can be ignored, as written in the code. But it does not seems to be documented yet. The opposite feature (only tables) is barely mentionned and it seems skip_table is to be configured the same way. I am no Rust expert, but I think you have to declare all of the ignored tables, no wildcard option for now.

evoxmusic commented 2 years ago

Hello @patrick-grow-therapy , i've been looking for the same feature. It seems tables can be ignored, as written in the code. But it does not seems to be documented yet. The opposite feature (only tables) is barely mentionned and it seems skip_table is to be configured the same way. I am no Rust expert, but I think you have to declare all of the ignored tables, no wildcard option for now.

Feel free to open a PR to update the documentation 🙏

--

Adding a wildcard option to anonymize all fields from a table is something that I would love to add. But I have not enough time at the moment. I'd be happy to find a sparking partner to make it happen.