Redact/scrub string values by default in transformed query text/plan tables

llooker / blocks_redshift_admin

MIT License

19 stars 86 forks source link

Redact/scrub string values by default in transformed query text/plan tables #39

Closed fabio-looker closed 5 years ago

fabio-looker commented 5 years ago

Since strings may contain sensitive data, e.g. within filter values, it would be good to use a regex to redact all strings by default when creating the block's PDTs

taylor67 commented 5 years ago

+1 Avalere health

taylor67 commented 5 years ago

Places to update:

Table: redshift_queries

Columns: text, snippet
- Come from Redshift system tables:
- SVL_QLOG.substring - Truncated query text (from redshift docs)
- STL_QUERY.querytxt - Actual query text for the query

Table: redshift_plan_steps

Column: operation_argument
Come from Redshift system tables:
- stl_explain.plannode - The node text from the EXPLAIN output

fabio-looker commented 5 years ago

Resolved by the above PR