Extension Request: Postgresql Anonymizer

neondatabase / neon

Neon: Serverless Postgres. We separated storage and compute to offer autoscaling, code-like database branching, and scale to zero.

https://neon.tech

Apache License 2.0

13.26k stars 374 forks source link

Extension Request: Postgresql Anonymizer #3796

Open mingfang opened 1 year ago

mingfang commented 1 year ago

https://www.postgresql.org/about/news/postgresql-anonymizer-10-privacy-by-design-for-postgres-2452/

vadim2404 commented 6 months ago

@lubennikovaav to enable it this week

vadim2404 commented 6 months ago

Duplicate: #4970

vadim2404 commented 5 months ago

PR in pg_anonymizer https://github.com/neondatabase/postgresql_anonymizer/pull/3

To test in on preview today/tomorrow

vadim2404 commented 5 months ago

Status update: will be picked up after pgbouncer fixes

vadim2404 commented 5 months ago

in testing

vadim2404 commented 5 months ago

in review

lubennikovaav commented 4 months ago

This extension is now available on staging and prod behind feature flag Anon Extension (can be enabled per-user in Admin console). Also for most use-cases, this extension should be added to shared_preload_libraries in compute spec: pg_settings{"shared_preload_libraries": "neon,anon"}.

@raoufchebri is testing it now, as soon as it will pass internal check, I will start gradually enabling it for clients.

vadim2404 commented 4 months ago

@seymourisdead, I guess it can be a good candidate for feature preview that users can enable on their behalf

vadim2404 commented 4 months ago

It's on production under feature flag

andreasscherbaum commented 4 months ago

Figure out workflow for users. No issues found during testing. Discuss with Ann

@raoufchebri Do you have an update on the rollout?

andreasscherbaum commented 3 months ago

According to Raouf the extension is tested, and works well. There are some inherent challenges, these are listed and explained in an upcoming blog posting.

andreasscherbaum commented 3 months ago

Rollout plan:

Unblock newer Compute images (unrelated to this ticket)
Include this extension in new copute image
Release it
Another test, ideally by a customer
Announce it
Publish blog posting (already written)

andreasscherbaum commented 3 months ago

There is a feature flag, which is not enabled for all users. Enable it for everyone. Then remove the feature flag.

kelvich commented 3 months ago

andreasscherbaum commented 3 months ago

See if the error message can be improved, and point the user to what needs to be done (loading the library). The library is not there because the feature flag is not enabled, but the error message can happen anywhere, not just in Neon.