GEN-996 - Allow PII Processor without storing Sample Data - Githubissues

open-metadata / OpenMetadata

OpenMetadata is a unified metadata platform for data discovery, data observability, and data governance powered by a central metadata repository, in-depth column level lineage, and seamless team collaboration.

https://open-metadata.org

Apache License 2.0

5.26k stars 994 forks source link

GEN-996 - Allow PII Processor without storing Sample Data #17927

Closed pmbrull closed 1 week ago

pmbrull commented 1 week ago

Describe your changes:

We will fetch the sample data from the source if we have generateSampleData or processPIISensitive as true
We will only store the sample data if generateSampleData is enabled

#

Type of change:

[ ] Bug fix
[ ] Improvement
[ ] New feature
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
[ ] Documentation

#

Checklist:

[x] I have read the CONTRIBUTING document.
[ ] My PR title is Fixes <issue-number>: <short explanation>
[ ] I have commented on my code, particularly in hard-to-understand areas.
[ ] For JSON Schema changes: I updated the migration scripts or explained why it is not needed.

notion-workspace[bot] commented 1 week ago

PII Tagging in profiler without Sample Data Gen